Tools and Utilities>Miscellaneous>robots.spider(tm)

robots.spider(tm) free download

robots.spider(tm) details

GPLLicense :

linuxPlatform :

Betsy A. GamratAuthor :

FreePrice :

robots.spider(tm) reads the robots.txt file, then spiders the site (depth is adjustable in the downloaded code), to check for references to entries in the robots.txt file. robots.spider(tm) can help you avoid disclosing the names of directories you don't want indexed, that aren't referenced in your site code. It is an open source (PHP) script, you can run it for free off the demo link, or download the code, adjust the depth, and use it to check your sites from a different server.

robots.spider(tm) is the property of respective authors, vendors and developers. You can download robots.spider(tm) for your hardware. If you want to use robots.spider(tm) for other purpose, Please contact the authors, vendors and developers of robots.spider(tm).

RELATED DOWNLOADS

Diino
Diino is a secure online storage service with advanced (but still very easy to use) file sharing features. The software also includes a user friendly online backup tool, a secure e-mail client, a pers
Email Address Encoder
Prevents automated email address harvesters from capturing your address from your web pages. Easy to use, outputs JavaScript that you can insert right into your web page. PHP is not required. No progr
XP Look
This is a graphical interface to update old programs, give them the look of Windows XP or Vista with rounded and shaded widgets,just by adding a xml file to the executable. Works under Windows XP or
Content Scrubber
Content Scrubber Email Marketing tool is a simple to use desktop application that allows you test your messages for words and phrases that might trigger the spam filters, before you send your emails o
google pagerank predictor
As most people out there know the page rank of a website is very important. You also want to know how much traffic your website receives and how highly your site is going to be ranked in search engine

Ajax : ASP : ASP.NET : C and C++ : CFML : CGI and Perl : Flash : Java : JavaScript : PHP : Python : Remotely Hosted : Ruby on Rails : Tools and Utilities : XML