It just needs something to make it hit test visible which is easy as adding Background="Transparent"
like;
<ScrollViewer Height="300" Width="500" Background="Transparent">
or put in your background color or something if you want. I know seems retarded, but it's all you need.
Hope this helps.