View unanswered posts | View active topics |



Print view
Previous topic | Next topic 

Banning of Search engines crawlers

Post new topic Reply to topic  Page 1 of 1
  [ 7 posts ] 
 
Author Message
PeanutsRevenge
 Post subject: Banning of Search engines crawlers
PostPosted: Sat Jun 11, 2011 9:05 pm 
User avatar
Obliterated

Current Scorched3D Rank: 3

Joined: Sun Oct 21, 2007 5:44 am
Posts: 1733
Location: Bournemouth, South England
Why were the crawlers banned (google, msn, yahoo), place doesn't get much attention as is, without blocking the main source of free avertising!

"06:24:00AM: ArmorWraith says:
Band the google msn and yahoo crawlers, dunno if itll stay that way though"
Chopper wrote:
You mean the one where i'm surrounded by all these little peanuts....they all have hatchets....they're chasing me...and then there's this BIG peanut....and he's all purple and green ...he's trying to grab me....AArrYYYHHHGGGGG... [-o<

Top
 Profile  
 
Laptops Daddy
 Post subject: Re: Banning of Search engines crawlers
PostPosted: Wed Jun 15, 2011 7:51 pm 
User avatar
Obliterated

Current Scorched3D Rank: Unranked

Joined: Wed Jun 14, 2006 11:18 pm
Posts: 1481
Location: United Kingdom
shouldnt make any difference. thrax said something about giving them accounts for some reason or other, but they should still be able to index the forums without.

normally youd just add Disallow rules to robots.txt
Top
 Profile  
 
ArmorWraith
 Post subject: Re: Banning of Search engines crawlers
PostPosted: Wed Jun 15, 2011 7:54 pm 
User avatar
Obliterated

Current Scorched3D Rank: Unranked

Joined: Mon Jun 22, 2009 6:26 pm
Posts: 1591
The matter has been resolved.. I was unaware they were beneficial.. I seen the word bot and had deleted them thinking they would clutter the forums..

My bad. #-o

Armor
Image

Top
 Profile  
 
PeanutsRevenge
 Post subject: Re: Banning of Search engines crawlers
PostPosted: Thu Jun 16, 2011 12:06 am 
User avatar
Obliterated

Current Scorched3D Rank: 3

Joined: Sun Oct 21, 2007 5:44 am
Posts: 1733
Location: Bournemouth, South England
Laptops Daddy wrote:
shouldnt make any difference. thrax said something about giving them accounts for some reason or other, but they should still be able to index the forums without.

normally youd just add Disallow rules to robots.txt


Good Point!

Membership is only required for submitting, not reading :|
Chopper wrote:
You mean the one where i'm surrounded by all these little peanuts....they all have hatchets....they're chasing me...and then there's this BIG peanut....and he's all purple and green ...he's trying to grab me....AArrYYYHHHGGGGG... [-o<

Top
 Profile  
 
gcamp
 Post subject: Re: Banning of Search engines crawlers
PostPosted: Sun Jun 19, 2011 12:44 pm 
User avatar
Site Admin
Not Signed Up For Stats

Joined: Mon Aug 04, 2003 4:09 pm
Posts: 4771
Location: Scotland
As far as I know the bot accounts get a much reduced page, with no graphics etc... so they can crawl the site more efficiently.
Top
 Profile  
 
comedown
 Post subject: Re: Banning of Search engines crawlers
PostPosted: Wed Jun 22, 2011 9:10 am 
User avatar
Burned to a crisp

Current Scorched3D Rank: Unranked

Joined: Tue Jan 25, 2005 6:34 pm
Posts: 381
Location: bed
What a hilarious blunder.
"You cannot add administrators and moderators to your foes list."

Top
 Profile  
 
nila
 Post subject: Re: Banning of Search engines crawlers
PostPosted: Sat Aug 20, 2011 12:01 pm 
Uncooked
Not Signed Up For Stats

Joined: Sat Aug 20, 2011 11:56 am
Posts: 5
It is a interesting sharing...........
Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  Page 1 of 1
  [ 7 posts ] 

Board index » Chat & Discussion » general and gameplay

Who is online

Users browsing this forum: No registered users and 0 guests

You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group