Try Our Apps


Gobble up these 8 terms for eating

standard for robot exclusion

standard for robot exclusion in Technology
World-Wide Web
A proposal to try to prevent the havoc wreaked by many of the early World-Wide Web robots when they retrieved documents too rapidly or retrieved documents that had side effects (such as voting). The proposed standard for robot exclusion offers a solution to these problems in the form of a file called "robots.txt" placed in the document root of the web site.
W3C standard (
The Free On-line Dictionary of Computing, © Denis Howe 2010
Cite This Source

Word of the Day

Word Value for standard

Scrabble Words With Friends