Well, as I started typing this up, I figured it out (mind you, this has been driving me nuts for months now).
Right click on the style and unselect the Font option. This will allow you to use your default font. It doesn't give you the option to specify your own font without creating a new custom style (which is pretty annoying) Ok, so you go to Format then the Font tab Not exactly clear:
(source: contextures.com)
(source: computergaga.com)