Welcome Guest! To enable all features please Login or Register.

Notification

Icon
Error

stopping Search bots?
sunzout
#1 Posted : Monday, 22 February 2010 9:02:26 AM(UTC)
Rank: Member

Joined: 28/08/2009(UTC)
Posts: 9
Location: Chicago

I get serverl "System.IO.DirectoryNotFoundException" errors each day for objects that work fine when I test them.

The "HTTP_USER_AGENT" show that these are caused by Search bots like

Yahoo-MMCrawler
msnbot-media

Any particular things I can do to stop these errors?
Roger Martin
#2 Posted : Tuesday, 23 February 2010 11:54:47 PM(UTC)
Roger Martin

Rank: Administration

Joined: 3/08/2007(UTC)
Posts: 3,301
Location: Fort Atkinson, WI

Add the following to the <head> section of the web page containing the gallery control (this is default.aspx in a standard GSP installation):

Code:
<meta name="robots" content="noindex,nofollow" />


Use noindex when you don't want the search engines to add the page to their index. Use nofollow when you don't want the search engines to follow any links off of that page.
Roger Martin
Creator and Lead Developer of Gallery Server Pro
sunzout
#3 Posted : Thursday, 25 February 2010 8:16:26 AM(UTC)
Rank: Member

Joined: 28/08/2009(UTC)
Posts: 9
Location: Chicago

Thanks I'll try that.
Rss Feed  Atom Feed
Users browsing this topic
Guest
You cannot post new topics in this forum.
You cannot reply to topics in this forum.
You cannot delete your posts in this forum.
You cannot edit your posts in this forum.
You cannot create polls in this forum.
You cannot vote in polls in this forum.