charon-nm: Add support for custom server ports