Robots.txt |
Robots.txt |
Jul 11 2008, 12:04 AM
Post
#1
|
|
WSF Regular Group: PM Unlimited Posts: 49 Joined: 11-June 08 From: England Member No.: 1,541 Exchanges: www.mysurf.biz |
Hi, after noticing that a few search engines had indexed my /manager/ folder, i added a robots.txt like this to my root folder:
CODE User-agent: * Disallow: /manager/ Disallow: /cgi-bin/ I would suggest everyone do the same. Also maybe more folders should not be indexed, please let me know here. Regards, Chris - MySurf.Biz -------------------- |
|
|
Lo-Fi Version | Time is now: 31st October 2024 - 03:16 AM |