Robots.txt |
![]() ![]() |
Robots.txt |
![]() ![]()
Post
#1
|
|
![]() WSF Regular ![]() Group: PM Unlimited Posts: 49 Joined: 11-June 08 From: England Member No.: 1,541 Exchanges: www.mysurf.biz ![]() |
Hi, after noticing that a few search engines had indexed my /manager/ folder, i added a robots.txt like this to my root folder:
CODE User-agent: * Disallow: /manager/ Disallow: /cgi-bin/ I would suggest everyone do the same. Also maybe more folders should not be indexed, please let me know here. Regards, Chris - MySurf.Biz -------------------- |
|
|
![]() ![]() |
![]() |
Lo-Fi Version | Time is now: 8th September 2024 - 06:46 AM |