Redirect them from the url with #
to the url without #
RewriteRule ^(.+)\/(.*)$ $1#/$2 [R=301, L]
Or if you want to allow only specific characters
RewriteRule ^([\w\-]+)\/(.*)$ $1#/$2 [R=301, L]
Its not tested, but it should give you the idea.