Search in: Word
Vietnamese keyboard: Off
Virtual keyboard: Show
Computing (FOLDOC) dictionary (also found in English - Vietnamese, English - English (Wordnet), French - Vietnamese)
spider
Jump to user comments
World-Wide Web (Or "robot", "crawler") A program that
automatically explores the World-Wide Web by retrieving a
document and recursively retrieving some or all the documents
that are referenced in it. This is in contrast with a normal
web browser operated by a human that doesn't automatically
follow links other than inline images and URL redirection.
The algorithm used to pick which references to follow
strongly depends on the program's purpose. Index-building
spiders usually retrieve a significant proportion of the
references. The other extreme is spiders that try to validate
the references in a set of documents; these usually do not
retrieve any of the links apart from redirections.