When the "content" was small enough to fit on 1 page, the footer would display fine on that page. Once "content" spanned multiple pages, the footer would only display on the last page.
Turns out that I needed to place the footer BEFORE the content in order for it to be displayed on every page...
<div class="footer">
Page <span class="pagenumber"></span> of <span class="pagecount"></span>
</div>
<div class="content">
lots of content that spans multiple pages in here...
</div>
Looks like it's the same deal if headers are involved...they should be before page content.
Some links related to this (the last one being an example of proper format of html/css):