standard for robot exclusion

Computing Dictionary

standard for robot exclusion definition

World-Wide Web
A proposal to try to prevent the havoc wreaked by many of the early World-Wide Web robots when they retrieved documents too rapidly or retrieved documents that had side effects (such as voting). The proposed standard for robot exclusion offers a solution to these problems in the form of a file called "robots.txt" placed in the document root of the web site.
W3C standard (http://w3.org/TR/html4/appendix/notes.html#h-B.4.1.1).
(2006-10-17)

The Free On-line Dictionary of Computing, © Denis Howe 2010 http://foldoc.org
Cite This Source

00:10

00:09

00:08

00:07

00:06

00:05

00:04

00:03

00:02

00:01

Standard for robot exclusion is always a great word to know.
So is callithumpian. Does it mean:
a scrap or morsel of food left at a meal.
a children's mummer's parade, as on the Fourth of July, with prizes for the best costumes.
Dictionary.com, LLC. Copyright © 2012. All rights reserved.
  • Please Login or Sign Up to use the Recent Searches feature
FAVORITES
RECENT