19,155 tutorials online
16 tutorials pending review
763 dead links removed





Concurrent WebCrawler

User Rating: Not yet rated
Source Website: sites.google.com
Viewed: 106 times
Reported For Abuse / Broken Link: 0 times
(Report Link)

Rate this tutorial:


Description:
The tutorial describes a way to implement a Web Crawler in Java; a program which crawls through the internet and indexes web pages for later retrieval by a search engine. The focus is on proper concurrency - that is how to process multiple links at the same time using a breadth-first algorithm without running into threading issues. For now, the links are graphed out and displayed, simple indexing will be implemented in subsequent versions.






Other Tutorials From This Category
    Concurrent WebCrawler