Yes, you'll get a big performance boost with WebGL. Consider using the excellent 2D rendering system called Pixi. It renders sprites to WebGL with a fallback to Canvas.
Or, you can make your own low-level WebGL sprite rendering system using game-shell and gl-modules. gl-now is a good entry point into these modules. You can use them to build your own game engine.
Phaser, is an complete HTML5 game engine that currently has a lot of traction, and uses Pixi under the hood for rendering. A better place than Stackoverflow to look for help about all these issues is http://www.html5gamedevs.com.