It looks like vmin
is behaving in Firefox.
Here's a jsfiddle I made for testing: http://jsfiddle.net/noahcollins/Sc8gm/
It sounds like you're seeing the issue in chrome? As Bazzz pointed out, there's a Chrome bug that's still open. I was able to replicate it in Canary. The CSS Tricks article can help you get around it with some javascript if you're so inclined.
Another thing to keep in mind: support for vmin
in mobile browsers is very limited at this time, so it will be an issue in the case when users rotate between portrait & landscape.