After all, I had to go with just the Selenium Web driver, and these specific versions, it seems they are out of sync at some point and capybara/its wrapper won't be able to communicate with the driver underneath and therefore Phantom, as a consequence, is not accessible.
This configuration worked for me:
gem 'capybara', '1.1.4'
gem 'selenium-webdriver', '2.27.2'