Jump to content
MrsSurvival Discussion Forums

Question


CeeGee

Recommended Posts

Ok...I'll try to explain this in my limited way because I'm not exactly sure I'm right. Spiders are web crawlers, or program which scans websites by following each link and then generates various information based on the type of search conducted. So if you enter Mrs S through doing a Google search, it may show that a spider is online, because the program was crawling around here and reporting back that yes, this is the place.

 

 

Link to comment

A Spider is an automated program that "crawls" the world wide web gathering data. A Web Spider is also known as Web Crawler, Web Robot or Web Scutter. Other names used less frequently for Web crawlers are ants, automatic indexers, bots, and worms.

 

The data gathered is mainly used by search engines for providing up to date information, however, spiders can also be used for automating maintenance tasks on a Web site, such as checking links or validating codes. Spiders can also be used to gather specific types of information from Web pages, such as harvesting e-mail addresses for spam.

 

Link to comment
  • 1 month later...

Archived

This topic is now archived and is closed to further replies.

×
×
  • Create New...

Important Information

By using this site, you agree to our Terms of Use.