How can a robots.txt ignore anything with action=history in it?
-
22-09-2019 - |
Question
I have a MediaWiki, and I don't think I want Google indexing the history of any page. How can a robots.txt
disallow URLs with action=history
in the query string?
Solution
The HTML for the history view (and several others, such as the logs, etc.) contains a "noindex,nofollow" meta declaration. Compliant user agents, such as Googlebot, will honour this advice and not bother indexing the page.
Licensed under: CC-BY-SA with attribution
Not affiliated with StackOverflow