Most browsers need to run in an x display. I solve this by running xvfb (apt-get install xvfb).
Then python needs to be able to use this display: https://pypi.python.org/pypi/PyVirtualDisplay
Start the display, then initialize the webdriver browser and test away...