Web Crawler to index billions of websites for inbound links
$1500-3000 USD
Cancelled
Posted over 12 years ago
$1500-3000 USD
Paid on delivery
Looking for a high speed web crawler that will index billions of root domains and web pages and index/organize the results. The end product will be the ability to type in a URL and have all incoming links to the URL displayed.
End product:
User types in [login to view URL]
Website displays all inbound links (links pointing to [login to view URL]) using information taken from crawler.