Devise is just released a new rc gem which is compatible with Rails 4.
gem 'devise', '~> 3.0.0.rc'
Other option, you could use 'rails4' branch from devise master github repo.
gem 'devise', github: 'plataformatec/devise', branch: 'rails4'
And of course don't forget a 'bundle install' after Gemfile update.