This forum has been moved here:
Helicon Tech Community Forum

ISAPI_Rewrite 3.0 (Forum Locked Forum Locked)
 Helicon Tech : ISAPI_Rewrite 3.0
Subject Topic: excluding https in case of 301 redirect
Author
Message |
Akat
Newbie


Joined: 09 May 2010
Location: Netherlands
Posts: 15
Posted: 08 November 2011 at 4:25pm

I am running into a small issue regarding the duplicate content for our site. I am refering to the following google article
http://www.google.com/support/webmasters/bin/answer.py?answer=66359

I know that I have to have a rule to exclude the Google bot by having a rule in the ISAPI rewrite 3.0 module running on our IIS6 Windows Server + Coldfusion 9

The rule I wrote is

# Rule to exclude Google bot

RewriteEngine on

#Options +FollowSymlinks

RewriteCond %{SERVER_PORT} ^443$

RewriteRule ^robots.txt$ robots_ssl.txt

But some how I had to leave the #Option +FollowSymlinks commented out, it was written for Apache not IIS. What can I do about it ?

Regards / Spasiba

Anthony



__________________
Anthony Katgert
Back to Top
 
Guests
Guest


Joined: 01 October 2003
Online Status: Online
Posts: -160
Posted: 11 November 2011 at 5:59am

Hello Anthony,

You can check an example of "Block annoying robots" or "Emulating load balancing" in examples section.
Why do you need 443 port as a condition?

Vsegda radi pomoch.

Regards
Andrew
Back to Top
 
Akat
Newbie


Joined: 09 May 2010
Location: Netherlands
Posts: 15
Posted: 12 November 2011 at 3:48pm

AndrushkaUS wrote:
Hello Anthony,

You can check an example of "Block annoying robots" or "Emulating load balancing" in examples section.
Why do you need 443 port as a condition?

Vsegda radi pomoch.

Regards
Andrew

No Andrew,

I am hoping to prevent the google bot to see our https pages as duplicate content or vice versa.

 



__________________
Anthony Katgert
Back to Top
 
Guests
Guest


Joined: 01 October 2003
Online Status: Online
Posts: -160
Posted: 14 November 2011 at 7:41am

So, basically you need:

1) Condition for %{HTTPS} variable
2) Condition for %{USER_AGENT}
3) rule to send robot to FORBIDDEN 403 PAge

Correct?

Regards
Andrew

Edited by AndrushkaUS - 14 November 2011 at 7:46am
Back to Top
 
Akat
Newbie


Joined: 09 May 2010
Location: Netherlands
Posts: 15
Posted: 14 November 2011 at 10:27am

Basically I need to redirect 301 to counter the canonical
duplicate content. So I want to stop the Google bot(s) to
index my https pages by using the rule that I came across
http://www.seoworkers.com/seo-articles-tutorials/robots-
and-https.html

But I believe we then be better served with an upgrade to
Helicon Ape and add the rules outlined in the post I refer
to.


__________________
Anthony Katgert
Back to Top
 
Guests
Guest


Joined: 01 October 2003
Online Status: Online
Posts: -160
Posted: 16 November 2011 at 7:51am

You may try using:

Code:
RewriteEngine on
RewriteBase /

RewriteCond %{SERVER_PORT} ^443$
RewriteRule ^robots.txt$ robots.asp [NC,R=301,L]


This might get you to 301-redirect.

Regards
Andrew
Back to Top
 
Akat
Newbie


Joined: 09 May 2010
Location: Netherlands
Posts: 15
Posted: 21 November 2011 at 3:11pm

AndrushkaUS wrote:
You may try using:

Code:
RewriteEngine on
RewriteBase /

RewriteCond %{SERVER_PORT} ^443$
RewriteRule ^robots.txt$ robots.asp [NC,R=301,L]


This might get you to 301-redirect.

Regards
Andrew

Andrew

This is not working for me, would I not be better of with Helicon Ape.
Regards

Anthony


__________________
Anthony Katgert
Back to Top
 
Guests
Guest


Joined: 01 October 2003
Online Status: Online
Posts: -160
Posted: 22 November 2011 at 7:09am

Of course Ape would work. But there's nothing that must prevent ISAPI_Rewrite from doing this.
Would you, please, provide the rewrite.log for the testing request?
Logging issues described in FAQ

Regards
Andrew
Back to Top
 
Akat
Newbie


Joined: 09 May 2010
Location: Netherlands
Posts: 15
Posted: 22 November 2011 at 1:54pm

Andrew

Were do you want me to post the rewrite.log ?



__________________
Anthony Katgert
Back to Top
 
Guests
Guest


Joined: 01 October 2003
Online Status: Online
Posts: -160
Posted: 23 November 2011 at 7:22am

Doesn't matter to me.
You can post an extract here, on forum.
Please, make sure you don't post all 4-10mb long. You may find your testing request in the log by keywords that are the same for each new request:
Quote:
(2) init rewrite engine with requested uri ...


Regards
Andrew
Back to Top
 
Akat
Newbie


Joined: 09 May 2010
Location: Netherlands
Posts: 15
Posted: 25 November 2011 at 1:40am

Code:
66.249.71.57 66.249.71.57  Tue, 22-Nov-2011  19:10:15 GMT [www.pasioingredients.eu/sid#1422229386][rid#21507192/initial] (2) init rewrite engine with requested uri /index.cfm?fuseaction=product.tags&tag=SAM-e

 

I am not sure if this helps. I could not find a init rewrite request



Edited by Akat - 25 November 2011 at 1:41am


__________________
Anthony Katgert
Back to Top
 
Guests
Guest


Joined: 01 October 2003
Online Status: Online
Posts: -160
Posted: 25 November 2011 at 5:34am

Yes,

If that's the testing request we need, than I need everything from this line until next request beginning.

Regards
Andrew
Back to Top
 
Akat
Newbie


Joined: 09 May 2010
Location: Netherlands
Posts: 15
Posted: 28 November 2011 at 1:34pm

AndrushkaUS wrote:
Yes,

If that's the testing request we need, than I need everything from this line until next request beginning.

Regards
Andrew

Andrew, I still in the middle if order an upgrade to Ape or... pay HeliconTech for support on my current ISAPI Rewrite 3.0

I losing ranking in Google. Please make the case for not upgrading. I am currently running ISAPI Rewrite 3.0 with IIS6 (Windows 2003 Server) and Adobe Coldfusion 9

 

 



__________________
Anthony Katgert
Back to Top
 
Guests
Guest


Joined: 01 October 2003
Online Status: Online
Posts: -160
Posted: 30 November 2011 at 3:02am

Anthony,

I sent you a message yesterday via email. I suggest we continue correspondence there and assign meeting.
Please, see your inbox for more info.

Regards
Andrew
Back to Top
 

Sorry, you can NOT post a reply.
This forum has been locked by a forum administrator.

Printable version Printable version