“robots.txt” “Disallow:” filetype:txt

The robots.txt file serves as a set of instructions for web crawlers. The “disallow” tag tells a web crawler where NOT to look, for whatever reason. Hackers will always go to those places first!

Click below for the Google search ==> “robots.txt” “Disallow:” filetype:txt

http://www.google.com/search?hl=en&lr=&ie=UTF-8&oe=UTF-8&q=%22robots%2Etxt%22+%2B+%22Disallow%3A%22+filetype%3Atxt

---

Possibly related posts: (automatically generated)

• filetype:conf inurl:proftpd.conf -sample
• “A syntax error has occurred” filetype:ihtml
• filetype:reg reg HKEY_CURRENT_USER username
• View hidden web pages!