Scott Fields à Terry Brooks Autumn 2004
Results of searches:
1. Googlebot
tracking
In the ACM portal, I found no citations that were right on your topic. Only some related to “query log analysis,” “web usage mining,” and “query processing.”
There are 8 citations in my binder for you to review. The closest one is this—
Discovery of Web Robot Sessions Based on their Navigational Patterns
Searching the web, most of what I find is discussion in web designer online forums regarding search engine optimization (SEO) and tracking the GoogleBot using software like SpyderTrax and RobotStats. There were a few related articles in Search Engine Watch.
SpiderSpotting: When A Search Engine, Robot Or Crawler Visits
http://searchenginewatch.com/webmasters/article.php/2168001
Search Engines and Web Server Issues
http://searchenginewatch.com/searchday/article.php/3109261
Measuring Search Engine Success (search engine optimization)
http://searchenginewatch.com/searchday/article.php/3323241
Some web robot tracking software vendors—
CJ GoogleBot Activity http://www.cj-design.com/index.php?id=downloads&page=13
RobotStats http://www.robotstats.com/en/
SpyderTrax (Googletrax) http://www.darrinward.com/
Googlebot FAQs http://www.google.com/bot.html
Web robots FAQs http://www.robotstxt.org/wc/faq.html
Some of the index terms and keywords I used in the ACM portal—
track* Googlebot
Googlebot activity
web traffic analy*
search engine optimization
search process
query log analysis
analysis web quer*
google query log
data mining
web robot detection
web usage mining
query processing
query AND optimization