At some point video renderers allocate resources on hardware, esp. Direct3D devices, and this initialization is not instant, and causes some delay or flickering. When you bridge, your strategy should be to keep video renderer and its hosting graph, and switch stuff behind it. This gets you smooth and flicker-less operation.
Switching VMR to EVR (reason?) is unlikely to be smooth. Or, just keep both running at all times and just put one in front of the other as needed.