paste.libre-service.eu-priv.../robots.txt
rugk a5730b701c Revert order change
According to Wikipedia this is indeed right.. https://en.wikipedia.org/wiki/Robots_exclusion_standard#Allow_directive

Then there are only many wrong examples out there.
2016-07-03 13:09:47 +02:00

4 lines
114 B
Text

# Might as well keep robots away for performance and privacy reasons.
User-agent: *
Allow: /index.php
Disallow: /