I think you are better off testing the ViewModels, we do this in our my current project (Enterprise scale) and it works very well, very few bugs.
We use Qunit for our tests but Jasmine works too. Most bugs occur in the ViewModels and if you have advanced custom bindings you can test them seperate.