Requiring the tzinfo
gem before initializing the app in environment.rb
fixes the issue for me. Doesn't really explain everything, but seems to work
# adding this fixes the issue
require 'tzinfo'
# Initialize the rails application
RailsApp::Application.initialize!
Edit: Seems this was a problem with Rails: https://github.com/rails/rails/issues/13553