It was due to the fact that the video object was faded in by jQuery after the documented loaded and a link was clicked - I assume it was because of the fading transition that IE9 couldn't handle the video object properly.
What I did was allow the fade in, and once complete I cloned the video object to reinstantiate it.