Allow and disallow in robots.txt file
-
28-09-2020 - |
Domanda
I want to disallow all files and folders on my site from SE bots, except a special folder and files in it. Can I use these lines at robots.txt file?
User-agent: *
Disallow: /
Allow: /thatfolder
Is it right?
Soluzione
User-agent:*
Allow: /thatfolder
Disallow: /
This should do. (just changed the order)
Autorizzato sotto: CC-BY-SA insieme a attribuzione
Non affiliato a StackOverflow