The Most Active and Friendliest
Affiliate Marketing Community Online!

“Adavice”/  “1Win

Web Crawler ?

A web crawler (also known as a web spider or web robot) is a program or automated script which browses the World Wide Web in a methodical, automated manner. This process is called Web crawling or spidering. Many legitimate sites, in particular search engines, use spidering as a means of providing up-to-date data.
 
A crawler is a program that visits Web sites and reads their pages and other information in order to create entries for a search engine index.
 
A Web crawler is an Internet bot that systematically browses the World Wide Web, typically for the purpose of Web indexing. A Web crawler may also be called a Web spider, an ant, an automatic indexer, or (in the FOAF software context) a Web scutter.

Web search engines and some other sites use Web crawling or spidering software to update their web content or indexes of others sites' web content. Web crawlers can copy all the pages they visit for later processing by a search engine that indexes the downloaded pages so that users can search them much more quickly.

Crawlers can validate hyperlinks and HTML code. They can also be used for web scraping (see also data-driven programming).
 
A web crawler is a relatively simple automated program, or script, that methodically scans or "crawls" through Internet pages to create an index of the data it's looking for; these programs are usually made to be used only once, but they can be programmed for long-term usage as well.
 
Web crawler is also called as web spider or robots. It is one kind of software that visit our each web page periodically and fetch data about particular web page by meta data and show it in search result snippet.
 
It is an internet bot that browses the world wide web for the purpose of Web Indexing.A Web Crawler may also be called as Web Scutter or Web Spider.
 
banners
Back