User Agent Listing - Courtesy of Gary Keith |
| UserAgent |
Parent |
Browser |
| GJK_Browscap_Version |
GJK_Browscap_Version |
2004-01-09 18:44:49 GMT |
| HTML Validator http://www.searchengineworld.com/validator/ |
General Crawlers |
Search Engine World HTML Validator |
| AbachoBOT* |
Search Engines |
Abacho.com |
| Alta Vista |
Alta Vista |
Alta Vista |
| AltaVista Canada |
Alta Vista |
AltaVista Canada |
| AltaVista Intranet V1.0 bluewindow.ch webmaster@bluewin.ch |
Alta Vista |
AltaVista International |
| Aport |
General Crawlers |
Aport |
| Art-Online.com 0.9(Beta) |
General Crawlers |
Art-Online.com |
| Atomz* |
Search Engines |
Atomz Search |
| Automated Browscap.ini Updater. Gary contact me at serge@skycomp.ca
with problems. |
Browscap.ini Version Checkers |
Automated Browscap.ini Updater |
| BackRub/* |
Google |
Backrub/Google |
| Baiduspider* |
Search Engines |
BaiDu Chinese Search Engine |
| Best Whois (http://www.bestwhois.net/) |
Log Spammers |
Best Whois |
| BMC Link Validator (http://www.briansmodelcars.com/links/) |
General Crawlers |
BMC Link Validator |
| Botswana v0.* |
General Crawlers |
Botswana |
| Browscap.ini Version Checkers |
Browscap.ini Version Checkers |
Various |
| CerberianDrtrs/* |
General Crawlers |
Cerberian |
| CFM-SearchBot(http://www.cfm-search.com) |
General Crawlers |
CFM-SearchBot |
| CipinetBot (http://www.cipinet.com/bot.html) |
Search Engines |
CipinetBot |
| CJNetworkQuality; http://www.cj.com/networkquality |
General Crawlers |
CJNetworkQuality |
| Comodo HTTP(S) Crawler* |
General Crawlers |
Comodo HTTP Crawler |
| Computer_and_Automation_Research_Institute_Crawler |
General Crawlers |
Computer_and_Automation_Research_Institu |
| Cowbot* (NHN Corp*naver.com) |
General Crawlers |
Cowbot |
| Crawler admin@crawler.de |
Search Engines |
Crawler |
| Crawler0.* |
General Crawlers |
Crawler0 |
| Denmex websearch (http://search.denmex.com) |
Search Engines |
Denmex websearch |
| EchO!/2.0 |
Search Engines |
EchO |
| eseek-crawler.* (crawler@exactseek.com) |
Search Engines |
ExactSeek |
| Eule Robot* |
Search Engines |
Eule-Robot |
| Eule-Robot* |
Search Engines |
Eule-Robot |
| exactseek-crawler-2.63 crawler@exactseek.com |
Search Engines |
ExactSeek |
| Fast PartnerSite Crawler |
FAST-WebCrawler |
Fast PartnerSite Crawler |
| FAST-WebCrawler/3.6 (atw-crawler at fast dot no; http://fast.no/support/crawler.asp) |
FAST-WebCrawler |
N/A |
| FAST-WebCrawler/3.6/FirstPage (atw-crawler at fast dot no;http://fast.no/support/crawler.asp) |
FAST-WebCrawler |
N/A |
| FAST-WebCrawler/3.7 (atw-crawler at fast dot no; http://fast.no/support/crawler.asp) |
FAST-WebCrawler |
N/A |
| FAST-WebCrawler/3.7/FirstPage (atw-crawler at fast dot no;http://fast.no/support/crawler.asp) |
FAST-WebCrawler |
N/A |
| FAST-WebCrawler/3.8 (atw-crawler at fast dot no; http://fast.no/support/crawler.asp) |
FAST-WebCrawler |
N/A |
FAST-WebCrawler/3.8 (crawler at trd dot overture
dot com;http://www.alltheweb.com/help/webmaster/crawler) |
FAST-WebCrawler |
N/A |
| FAST-WebCrawler/3.8/Fresh (atw-crawler at fast dot no; http://fast.no/support/crawler.asp) |
FAST-WebCrawler |
N/A |
| FAST-WebCrawler/3.x Multimedia (mm dash crawler at fast dot
no) |
FAST-WebCrawler |
N/A |
| FAST-WebCrawler/3.x Multimedia |
FAST-WebCrawler |
N/A |
| FAST-WebCrawler |
FAST-WebCrawler |
FAST-WebCrawler |
| FirstGov.gov Search - POC: firstgov.webmasters@gsa.gov |
Search Engines |
FirstGov.gov Search |
| FRSEEKBOT |
General Crawlers |
FRSEEKBOT |
| GalaxyBot/* |
Search Engines |
GalaxyBot |
| GenCrawler* |
Search Engines |
GenCrawler |
| General Crawlers |
General Crawlers |
General Crawlers |
| Gigabot/* |
Search Engines |
Gigablast |
| Google |
Google |
Google |
| Googlebot/1.0 (googlebot@googlebot.com http://googlebot.com/) |
Google |
N/A |
| Googlebot/2.1 (?http://www.googlebot.com/bot.html) |
Google |
N/A |
| Googlebot-Image/1.0 (?http://www.googlebot.com/bot.html) |
Google |
Googlebot-Image |
| Gulliver* |
Search Engines |
Gulliver |
| Hatena Antenna/* |
General Crawlers |
Hatena Antenna |
| HenryTheMiragoRobot (http://www.miragorobot.com/scripts/mrinfo.asp) |
Search Engines |
Mirago |
| http://www.almaden.ibm.com/cs/crawler* |
General Crawlers |
IBM Research Division |
| http://www.almaden.ibm.com/cs/crawler* |
Search Engines |
IBM's WebFountain |
| http://www.nutch.org/ |
Nutch |
Nutch |
| HTTP-Test-Program |
General Crawlers |
WebBug |
| IlTrovatore-Setaccio/0.01-dev (IlTrovatore-Setaccio;http://www.iltrovatore.it/;
info@iltrovatore.it) |
Search Engines |
N/A |
| Industry+Update+Control |
General Crawlers |
Microsoft's Software Update Services |
| Infoseek SideWinder/* |
Search Engines |
Infoseek |
| Infosniff Sniffer |
Search Engines |
Infosniff Sniffer |
| Inktomi |
Inktomi |
Inktomi |
| Jigsaw/2.2.0 W3C_CSS_Validator_JFouffa/2.0 |
General Crawlers |
Jigsaw |
| Keyword Density/* |
General Crawlers |
Keyword Density |
| Link Checkers |
Link Checkers |
Link Checkers |
| LinkSweeper/1.0 |
General Crawlers |
LinkSweeper |
| LNSpiderGuy* |
Search Engines |
Lexis-Nexis |
| Log Spammers |
Log Spammers |
Log Spammers |
| Lycos* |
Search Engines |
Lycos |
| Marvin v0.3 |
General Crawlers |
MedHunt |
| Mediapartners-Google/2.1 (?http://www.googlebot.com/bot.html) |
Google |
Mediapartners-Google |
| mercator* |
Alta Vista |
AltaVista |
| Mozilla/*.* (compatible; AvantGo*) |
General Crawlers |
AvantGo |
| Mozilla/2.0 (compatible; Ask Jeeves/Teoma) |
Search Engines |
Ask Jeeves/Teoma |
| Mozilla/2.0 (TuringOS; Turing Machine;0.0) |
General Crawlers |
Anonymizer |
| Mozilla/3.0 (compatible) |
Search Engines |
Unknown/Various |
| Mozilla/3.0 (compatible; NetMind-Minder* |
Search Engines |
NetMind-Minder |
| Mozilla/3.01 (compatible;) |
Search Engines |
Unknown/Various |
| Mozilla/4.0 (compatible; * sureseeker.com) |
Search Engines |
SureSeeker |
| Mozilla/4.0 (compatible; *Wanadoo 5.3) |
Search Engines |
Wanadoo |
| Mozilla/4.0 (compatible; MSIE 5.0; www.galaxy.com;*; http://www.galaxy.com/info/crawler.html) |
Search Engines |
Galaxy/LOGIKA Search Engine |
| Mozilla/4.0 (compatible; MSIE 5.5; Windows 95; Searchalot.com) |
Search Engines |
SearchALot |
| Mozilla/4.0 (compatible; MSIE 5.5; Windows 98; searchengine2000.com* |
Search Engines |
Search Engine 2000 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows 98; Win9x 4.90;
SEARCHALOT IE6) |
Search Engines |
Searchalot |
| Mozilla/4.0 compatible ZyBorg/* (wn.zyborg@looksmart.net;http://www.WISEnutbot.com) |
ZyBorg/Looksmart |
ZyBorg Spider |
| Mozilla/4.0 compatible ZyBorg/* (ZyBorg@WISEnutbot.com;http://www.WISEnutbot.com) |
ZyBorg/Looksmart |
ZyBorg Spider |
| Mozilla/4.0 compatible ZyBorg/* Beta.112 (wn.zyborg@looksmart.net;http://www.WISEnutbot.com) |
ZyBorg/Looksmart |
ZyBorg/Looksmart |
| Mozilla/4.0 compatible ZyBorg/* Beta-d11(wn.zyborg@looksmart.net;http://www.WISEnutbot.com) |
ZyBorg/Looksmart |
ZyBorg/Looksmart |
| Mozilla/4.0 compatible ZyBorg/* Dead Link Checker (wn.zyborg@looksmart.net;http://www.WISEnutbot.com) |
ZyBorg/Looksmart |
ZyBorg Dead Link Checker |
| Mozilla/4.0 compatible ZyBorg/* DLC (wn.zyborg@looksmart.net;http://www.WISEnutbot.com) |
ZyBorg/Looksmart |
ZyBorg Dead Link Checker |
| Mozilla/4.0 compatible ZyBorg/* for Homepage (ZyBorg@WISEnutbot.com;http://www.WISEnutbot.com) |
ZyBorg/Looksmart |
ZyBorg Home Page Spider |
| Mozilla/4.0 compatible ZyBorg/1.0 Dead Link Checker Beta-*
(wn.zyborg@looksmart.net; http://www.WISEnutbot.com) |
ZyBorg/Looksmart |
N/A |
| Mozilla/4.7 (compatible; WhizBang; http://www.whizbang.com/crawler) |
Search Engines |
WhizBang |
| Mozilla/4.78 (TuringOS; Turing Machine; 0.0) |
General Crawlers |
Anonymizer |
| Mozilla/5.0 (Slurp/*) |
Inktomi |
Inktomi |
| Mozilla/5.0 usww.com-Spider-for-w8.net |
Search Engines |
W8.Net |
| msnbot/* (*http://search.msn.com/msnbot.htm) |
Search Engines |
MSN Search Prototype Web Crawler |
| NationalDirectory-SuperSpider/* |
Search Engines |
National Directory |
| NationalDirectory-WebSpider/* |
Search Engines |
National Directory |
| NPBot* |
General Crawlers |
NPBot |
| Nutch |
Nutch |
Nutch |
| NutchOrg/* (Nutch; http://www.nutch.org/docs/bot.html; nutch-agent@lists.sourceforge.net) |
Nutch |
NutchOrg |
| NZBot/1.0 (www.navigationzone.com/; enquiries@navigationzone.com) |
Search Engines |
Navigation Zone |
| Openfind data gatherer, Openbot/3.0* |
Search Engines |
Openbot |
| PicoSearch/1.0 |
Search Engines |
PicoSearch |
| Pompos |
Search Engines |
Pompos |
| Robot: NutchCrawler, Owner: wdavies@acm.org |
Nutch |
NutchCrawler |
| Sam Spade 1.14 |
General Crawlers |
Sam Spade |
| Scooter* |
Alta Vista |
AltaVista |
| Search Engine World Robots.txt Validator* |
General Crawlers |
Search Engine World Robots.txt Validator |
| Search Engines |
Search Engines |
Search Engines |
| search.ch* |
Search Engines |
Swiss Search Engine |
| SearchSpider* |
Search Engines |
SearchSpider.com |
| semanticdiscovery/* |
General Crawlers |
Semantic Discovery |
| sitecheck.internetseer.com* |
General Crawlers |
Internetseer |
| SiteSnagger |
Search Engines |
SiteSnagger |
| Slurp* |
Inktomi |
Inktomi's Web Robot |
| SlySearch* |
Search Engines |
SlySearch |
| SpamArrest.com-bot/* |
Log Spammers |
SpamArrest |
| Speedy Spider (http://www.entireweb.com) |
Search Engines |
entireweb.com |
| Speedy_Spider_(http://www.entireweb.com) |
Search Engines |
EntireWeb.com |
| Spinne/* |
Search Engines |
Spinne |
| sspider.batsch.com |
Search Engines |
Batsch |
| StackRambler/* |
Search Engines |
StackRambler |
| Submission Spider at surfsafely.com |
Search Engines |
SurfSafely.com |
| SwissSearch* |
Search Engines |
SwissSearch |
| Szukacz/1.5 (robot; www.szukacz.pl/jakdzialarobot.html; info@szukacz.pl) |
Search Engines |
Szukacz |
| Tutorial Crawler* |
General Crawlers |
N/A |
| UbiCrawler/* |
General Crawlers |
UbiCrawler |
| UCmore |
General Crawlers |
UCmore |
| URL Spider Pro/1.92 (innerprise.net) |
Search Engines |
URL Spider Pro |
| W3C_Validator/* |
General Crawlers |
W3C Validator |
| W3CLineMode* |
Link Checkers |
W3C Line Mode |
| WebFilter Robot 1.0 |
General Crawlers |
WebFilter Robot |
| WebFindBot(http://www.web-find.com) |
Search Engines |
WebFindBot |
| WebmasterWorldForumBot |
General Crawlers |
WebmasterWorldForumBot |
| WebTrends Link Analyzer |
Link Checkers |
WebTrends Link Analyzer |
| WebTrends/* |
General Crawlers |
WebTrends |
| Willow Internet Crawler by Twotrees V2.1 |
General Crawlers |
Willow Internet Crawler |
| Wotbox/* |
Search Engines |
Wotbox |
| YahooSeeker/* (compatible; Mozilla 4.0; MSIE 5.5; http://search.yahoo.com/yahooseeker.html) |
Search Engines |
YahooSeeker |
| YahooSeeker/1.0 (compatible; Mozilla 4.0; MSIE 5.5; http://help.yahoo.com/help/us/shop/merchant/) |
General Crawlers |
YahooSeeker |
| Yandex/1.01.001 (compatible; Win16; I) |
Yandex |
N/A |
| Yandex/1.03.000 (compatible; Win16; M) |
Yandex |
N/A |
| Yandex |
Yandex |
Yandex |
| ZyBorg/Looksmart |
ZyBorg/Looksmart |
ZyBorg/Looksmart |
| Table Information Provided by Gary
Keith. You can search his user
agent identification page to find any user agents not
listed on this table. As Gary updates his list and makes it
available for download, we will update this table. Or you
can check his site on a regular basis and
download the CSV file as he updates it. Should you find
something that isn't indexed in his database, please do us
a favor and submit
it to Gary. He has made it a life's work to track these
critters, and your help will allow him to identify them for
all of us. Thanks again Gary.
Table Last Updated on 1/11/04
By James R. Sanders
Email: webmaster@sanders-consultation-group-plus.com
If you have any suggestions to add to this article,
or have ideas for articles you would like to read, please feel free to contact
us and let us know. You can also feel free to contact us about questions you
might have when it comes to practical webmaster or website design issues in
today's online market. We welcome constructive criticism and want to know what
our visitors think of our site and services. You can either contact
us here, or click the contact link at the bottom of the page. Thanks in
advance, and we look forward to hearing from you.
About the Author
James R. Sanders is the owner of Sanders
Consultation Group Plus. He has been a webmaster and website designer since
1997. He has also been involved in self employment ventures since 1992. He is
presently a contributing author of NewbieHangout,
and has been published through WebProNews
and 4Rankings.com.
His writing is targeted to webmasters, would be webmasters, website designers,
would be website designers, self employed, or those researching information
looking for solutions to questions associated with design, business operations,
and promotion today. His goal is to provide practical information based upon
his years of experience to help webmasters, website designers, and self employed
people achieve their goals in today's competitive global market. You can subscribe
to his free newsletters at SCGP
- Newsletter and become a member of the SCGP Portal. If you like SCGP content
and would like to use it on your site, then check out our content
agreement and terms of use. Use our articles on your site without the hassles
of writing your own content. Get back to the things you could use your time
better for, like site promotion.
Back To Webmaster Resource Area Main Comment About This Article
Comments limited to 1000 characters

This page last updated:
Wednesday, October 19, 2005 11:27 AM
EST
|