It seems you must have both a valid .ruby-version file and a .ruby-gemset file in order for rvm to make the switch.
I was hoping it would switch gemsets and use the default ruby version, since the gemset is one of the existing gemsets for my default ruby. But that's not how it works.