I had to switch to Ubuntu 32 bit. I determined the problem is that qmake does not let you set the link directories for its core plugin libraries.
Other people interested in researching look into:
qmake -query
qmake -set QT_INSTALL_PATH
That seems to be the link directory being used, but I was unable to specify my own unqiue directory.