I found out what the problem was. In case anyone else is having this issue, here's the deal:
Apache 2.2 doesn't really support proxying web sockets. There's a module available, but it requires you to rebuild apache manually and that's not a route I want to take here.
What I did was swap apache for nginx, which supports web sockets nicely even in combination with a reverse proxy.