This forum has been moved here:
Helicon Tech Community Forum

  Active TopicsActive Topics  Display List of Forum MembersMemberlist  HelpHelp   RegisterRegister  LoginLogin
ISAPI_Rewrite 2.x (Forum Locked Forum Locked)
 Helicon Tech : ISAPI_Rewrite 2.x
Subject Topic: Block Google from indexing site
Author
Message |
whizzinisapi
Groupie


Joined: 21 May 2004
Location: United States
Posts: 50
Posted: 21 April 2011 at 1:51pm

Is there anyway to block Google from indexing our test
server using isapi? I have a robots.txt file with disallow
all. I also have meta content no index no follow and still Google sees the test site.
Back to Top
 
aspnewb
Newbie


Joined: 20 April 2011
Location: United Kingdom
Posts: 19
Posted: 21 April 2011 at 3:13pm

Cant you specify to only allow access from a specific ip addres in your .htaccess file?
Back to Top
 
Anton
Admin Group


Joined: 30 January 2007
Location: Ukraine
Posts: 10519
Posted: 22 April 2011 at 2:10am

Firstly, if you fed Google a sitemap, it will index your site even with no index and no follow in place.

As for ISAPI_Rewrite solution, you can try it like this:

[ISAPI_Rewrite]

RewriteCond User-Agent: Googlebot
RewriteRule .* $0 [F]

__________________
Regards,
Anton
Back to Top
 

Sorry, you can NOT post a reply.
This forum has been locked by a forum administrator.

Printable version Printable version
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot delete your posts in this forum
You cannot edit your posts in this forum
You cannot create polls in this forum
You cannot vote in polls in this forum