I think this is a question of how certain you are that they'll never be used. Are you working on a site that includes a CMS and markup that you don't personally control? Can you be sure that no one, ever, under any circumstances might use an h5?
If it's a static site that only you will ever edit, they by all means, you know what you're using and what you're not, and you'll presumably carefully preview any changes before publishing, so I don't see the harm in keeping your CSS a bit leaner by removing things you're not using at all.
But if you're not sure, I think the overhead of adding a couple more lines to cover it just in case is minimal, really.