Anti-Scraping - Page 2

wildfxp · 08-17-2008, 05:36 PM

Quote:

Originally Posted by uglygit

well for a start you can tell ze robots to stop indexing your flash files from robots.txt

or whatever your flash directory is

Thank you, but would that cause any problems with people embedding my games or problems with any of my games?

uglygit · 08-17-2008, 07:33 PM

Quote:

Originally Posted by wildfxp

Thank you, but would that cause any problems with people embedding my games or problems with any of my games?

no , I allow people to embed my games so long as they have an active link to my site.

putting the disallow in the robots.txt prevents google and other 'friendly' search engines from indexing those files . net result is if a 'webmaster' is looking for a file to hotlink and he cant hotlink from the site he's just played the game on he'll do a search on google for it.

wildfxp · 08-18-2008, 02:18 AM

Quote:

Originally Posted by uglygit

no , I allow people to embed my games so long as they have an active link to my site.

putting the disallow in the robots.txt prevents google and other 'friendly' search engines from indexing those files . net result is if a 'webmaster' is looking for a file to hotlink and he cant hotlink from the site he's just played the game on he'll do a search on google for it.

Thank you very much for your help, but in any way, would this cause problems with my SEO? Wouldn't it be better for google to see everything on my site or is this a "choose one or the other" problem :P

-Mike

uglygit · 08-18-2008, 08:10 PM

no it wont cause probs with seo.

wildfxp · 08-19-2008, 11:26 AM

Hmmm, interesting

Thanks, but do all arcades include the robots.txt file? or would I need to create one? If I do create one, it's just disallow on my swf location right?

Example: Disallow: /swf/

and that would be it?

-Mike

uglygit · 08-19-2008, 11:42 AM

I dont know if all arcade sites include the robots.txt , you can type the url of an arcade site to see in the browser bar i.e http://www.addictingames.com/robots.txt

heres a sample robots.txt

User-agent: *
Disallow: /games/
Sitemap: http://www.mysite.com/sitemap.txt

the disallow tells the robots top not look in the games directory or wherever your swf files are

wildfxp · 08-20-2008, 04:22 PM

Thank you very much

I'll give it a try!

08-18-2008, 08:10 PM	#14 (permalink)
uglygit Senior Member Join Date: Nov 2007 Location: United Kingdom Posts: 710	no it wont cause probs with seo. __________________ arcade games - fun for all the family flash games - more gaming fun than you can handle Fizzy - Earn $25 Dollars for signing up & 0.01 per click Mochi Publisher - Get cash for games already on your site BigFish - Mod already here game script - probably the most advanced script in the world

08-19-2008, 11:26 AM	#15 (permalink)
wildfxp Senior Member Join Date: Aug 2008 Posts: 651	Hmmm, interesting Thanks, but do all arcades include the robots.txt file? or would I need to create one? If I do create one, it's just disallow on my swf location right? Example: Disallow: /swf/ and that would be it? -Mike __________________ ADD MY NEW FACEBOOK APPLICATION! SUPPORT ME Buy one of my shares!! Founder of http://www.bloggin-ads.com Free online games and you Play Games Win Prizes Fun Online Games http://www.flashfort.com - under heavy construction http://www.neverwink.com - working on (I own myself)

08-19-2008, 11:42 AM	#16 (permalink)
uglygit Senior Member Join Date: Nov 2007 Location: United Kingdom Posts: 710	I dont know if all arcade sites include the robots.txt , you can type the url of an arcade site to see in the browser bar i.e http://www.addictingames.com/robots.txt heres a sample robots.txt User-agent: * Disallow: /games/ Sitemap: http://www.mysite.com/sitemap.txt the disallow tells the robots top not look in the games directory or wherever your swf files are __________________ arcade games - fun for all the family flash games - more gaming fun than you can handle Fizzy - Earn $25 Dollars for signing up & 0.01 per click Mochi Publisher - Get cash for games already on your site BigFish - Mod already here game script - probably the most advanced script in the world

08-20-2008, 04:22 PM	#17 (permalink)
wildfxp Senior Member Join Date: Aug 2008 Posts: 651	Thank you very much I'll give it a try! __________________ ADD MY NEW FACEBOOK APPLICATION! SUPPORT ME Buy one of my shares!! Founder of http://www.bloggin-ads.com Free online games and you Play Games Win Prizes Fun Online Games http://www.flashfort.com - under heavy construction http://www.neverwink.com - working on (I own myself)

Thread Tools
Show Printable Version Email this Page
Display Modes
Linear Mode Switch to Hybrid Mode Switch to Threaded Mode