IntelliJ support says the port should be edited in start.ini file (in the root directory of Jetty installation), so it seems it is not possible to set it in IntelliJ.
The other alternative of course is to embed Jetty as a library in a standard java application instead of creating a web application based on Jetty.