This is most likely because there isn't a style signed to the position for that module. In your templates JDOC element for the module position in question, make sure you have the style attribute set to XHTML.
<jdoc:include type="modules" name="my-position-name" style="xhtml" />