1) Run REGEDIT on your host machine.
2) Export the following key:
HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\Control\Terminal Server\WinStations\RDP-Tcp
3) Edit the .REG file and change the name of the key to something like:
HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\Control\Terminal Server\WinStations\RDP-Tcp-New
4) In the .REG file find
PortNumber
and change it to whatever port you want.
5) Import the .REG file back to the registry.