The problem I was having was creating a user in the development database, not production. So on the production VPS I had to run RAILS_ENV=production rails c
to create my user so there'd be a user record to login with.
Make sure to create the necessary records in the necessary environments if you run into something similar!