While I'm not sure why having the doctype and meta tag set still prevents the WebBrowser control running in IE11 mode, the reason why the registry hack didn't work is due to the difference in 32-bit and 64-bit registries.
If you are editing the registry for a 32-bit application, the registry entries for those applications will be found in an additional directory abstraction called Wow6432Node.
This is where the registry change should be made.