I finally did get it to work (So Phusion Passenger not working on Snow Leopard is not the correct answer). I ended up installing passenger through homebrew with the command:
brew install passenger
and then installed it again using
sudo passenger-install-apache2-module
So if anybody else runs across this you might give that a try.