Unfortunately, specifying a custom port for the SMTP Send Adapter is not possible.
To note, the BizTalk SMTP Adapter and the Send Mail task are completely different implementations so it's just an unhappy coincidence if neither support this.
One possible solution is to configure the Windows/IIS SMTP Service somewhere in the Group and let it relay the messages.