Results 51 to 53 of 53
Thread: What is a web crawler?
02-13-2017, 01:05 AM #51
Web Crawler works is only indexing the website page contents.
It is always traveling by the help of link and index every content of the page.
02-21-2017, 04:54 AM #52
Web crawler is akso khnow as web spider or web robot.it is a automated script
it browses the Web page in a methodical and automated manner.
The Web crawlers are basically used to create a copy of all the visited pages for later processing by a search engine,so that will index the downloaded pages to provide fast searches.
03-16-2017, 06:24 AM #53
A web crawler is a generic term used for any program (robot or spider) that automatically discover and scan websites by following links in a methodical manner.
By jaydee in forum Google ForumReplies: 3Last Post: 04-02-2010, 04:59 AM