I believe you can use ApplicationCommands.NotACommand
to disable that input binding. This works for the standard WPF controls, and should work for that control as well.
For example:
<WebView>
<WebView.InputBindings>
<KeyBinding Key="Backspace" Command="ApplicationCommands.NotACommand"/>
</WebView.InputBindings>
</WebView>