You can use the --extra-scripts option introduced in py2app 0.7 to include a second script that starts the test in the application bundle and use that to run the tests.
I agree that it would be nice to have a way to run scripts with the application environment, could you file an issue for this in py2app's repository at https://bitbucket.org/ronaldoussoren/py2app?