Robots Web Directory.


Home \| About us \| Advertise \| Contact Us

Computers > Internet > Searching > Search Engines > Robots

Web Directory

Google Adwords

Google Adwords allows businesses to advertise on any number of sites, including Expo Central, regardless of the size of their budget. Ad campaigns can be set up to target based on keywords, geographical location of the visitor, and/or individual web sites. They handle the most common sizes of ads and allow text, image or video.

Firefox with Google Toolbar

Mozilla Firefox is a web browser with pop-up blocking, tabbed browsing, and privacy and security features. Integration of the Google Toolbar into the Firefox download offers users even more features: Google search, SpellCheck, and Autofill.

Google Pack Software

Get the power of Google on your desktop PCs! Google Pack provides a single installer for many essential PC applications from Google and other trusted partners. These applications improve your browsing with increased speed and security, provide better searching capability for the web and for your own PC and enable you to collect and organize your personal data, including photos.

Home > Computers > Internet > Searching > Search Engines > Robots
Directory of Web Resources @ Expo Central : Robots

Computers > Internet > Searching > Search Engines > Robots : Categories

Computers > Internet > Searching > Search Engines > Robots : Web Resources

Computers > Internet > Searching > Search Engines > Robots : Web-Sites

1. All About Search Indexing Robots and Spiders [ Report dead link ]

Search Tools Consulting explains how the search engine programs called "robots" or "spiders" work, and reviews related sites.

http://www.searchtools.com/robots/

2. ASAP Consulting: Robots/Crawlers DB [ Report dead link ]

Searchable list of robot agent strings with their description and links to home pages.

http://www.i-asap.net/crawlersdb.php

3. Bots vs Browsers [ Report dead link ]

This large database lists user agents in categories and distinguishes between robots and browsers.

http://www.botsvsbrowsers.com

4. HTTP User Agent Index [ Report dead link ]

An alphabetical list of user agents and the deployer behind them, compiled by Christoph Rüegg.

http://www.siteware.ch/webresources/useragents/db.html

5. List of Robot Agent Strings [ Report dead link ]

A list from PGTS of Web robots with the identifying data they leave in Web site logs.

http://www.pgts.com.au/pgtsj/pgtsj0208d.html

6. Psychedelix List of User-Agents [ Report dead link ]

Andreas Staeding's large list of search engine spiders, similar Web robots, and Web browsers: their web-log identification and links to their originators.

http://www.psychedelix.com/agents.html

7. Robot IP Address [ Report dead link ]

Brian Dunnintg provides a list of all the major search engine robot IP addresses, by full class C only.

http://www.briandunning.com/seo/

8. Robots, Spiders and Other User Agents: a Resource for WebMasters [ Report dead link ]

José Luis Pellicer's searchable database of robots, spiders and other user agents for programs that surf the web.

http://joseluis.pellicer.org/ua/

9. Robotstxt.org [ Report dead link ]

Information on the robots.txt Robots Exclusion Standard and other articles about writing well-behaved Web robots.

http://www.robotstxt.org/

10. Search Engine IP Addresses [ Report dead link ]

Lists IP addresses of search engine spiders. Can be searched by IP address. Also links to resources on spiders.

http://www.iplists.com/

Pages: [1] 2

Next Page >>

Help build the largest human-edited directory on the web.

Submit a Site - Open Directory Project - Become an Editor

Computers > Internet > Searching > Search Engines > Robots : Web Resources

[ Home | About us | Advertise | Contact Us ]