Find Jobs
Hire Freelancers

Crawler and parser

$100-300 USD

Cancelled
Posted almost 12 years ago

$100-300 USD

Paid on delivery
A python crawler and parser of links on web pages needs a few features added. At present it crawls links and lists them. It needs: 1) Saving the parsed and additional data into a fast database that can handle many millions of records without read or write delays or glitches 2) an added line to use proxies 3) add alexa rank of the top level domain of the crawled page, pagerank of the page, information if the link is a no-follow or do-follow, the link anchor, SERP position of the page, facebook, twitter and g+ likes of the page, time accessed and of course page of access to parsed record data. 4) Advise if LXML should be used a parser or if the current set-up is OK in terms of speed and being as light on the target websites as possible. **Important:** Please name the inventor of the Python programming language for your bid to be considered. The 3 days deadline is only a testing period. **The project WILL BE extended** IF sufficient progress is observed during the first 3 days and at each successive extension period.
Project ID: 2742106

About the project

Remote project
Active 12 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs

About the client

Flag of GUADELOUPE
Key Farto, Guadeloupe
4.7
32
Member since Jul 19, 2005

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.