When you are curious about the next Google Dance or just want to know when and which page is visited by search engine crawlers like me, I found some really nice PHP application from a french developer for you: RobotStats

RobotStats is a free application analysing the web robots visits on your site. For each page of your site, a small PHP code allows RobotStats to detect if the visitor is one of the 180 robots supported by the application. In this case, the visit is recorded in a MySQL data base.

You can even choose to detect when the Full Crawl begins and to get alerted then by email…

In the application you can see complete statistics:

• list of all the robots that came in a given period
• for each robot number of pages viewed, list of the pages viewed, with the date and time, graphic chart

RobotStats gives you precise information about the activity of the web robots on your site. It allows you to know if your site has any chance to be indexed in the search engines.

The robots can be identified by UserAgent (like many tools) and IP-adress(-ranges)... everything configured in a nice mySql database application implemented in PHP - really nice. and pre-configured… and easy to extend…

A nice installation and configuration tool makes the setup really easy…

Download and install RobotStats !

If you are curious about my site being leeched by Google and others – checkout my installation of RobotStats