You can place a newrelic.config file at the same location as the .exe file and it will get picked up instead of the main one in the agent install location. Once this is done you can alter the application name in the following location (near the top of the file):
<application>
<name>My Application</name>
</application>
You will probably need to restart the application in order for this to get picked up.