As posted by Simon in the comments on the original question, add a reference to:
Microsoft.VisualStudio.Shell.Immutable.10.0.dll
If you are using Microsoft.VisualStudio.Shell.Immutable.11.0.dll
then you will encounter a null SvsServiceProvider
.