Commerce website data scraper

This is a script that runs against a base URL and spiders through the links on the pages looking for product information. It then inserts this product information into a DB. Most likely this will need to be customized for specific sites, but if you take for example [url removed, login to view], I would like to have all the data from this site available in my DB. These will include things like the images for a product, the SKU numbers, the prices and shipping times. If you bid on this project I will describe in a lot more detail my requirements and give you the list of the sites I want to get data from. The final deliverable will be a script that runs periodically and updates the DB in the event that anything on the source website has changed.

## Deliverables

1) Complete and fully-functional working program(s) in executable form as well as complete source code of all work done.

2) Deliverables must be in ready-to-run condition, as follows (depending on the nature of the deliverables):

a) For web sites or other server-side deliverables intended to only ever exist in one place in the Buyer's environment--Deliverables must be installed by the Seller in ready-to-run condition in the Buyer's environment.

b) For all others including desktop software or software the buyer intends to distribute: A software installation package that will install the software in ready-to-run condition on the platform(s) specified in this bid request.

3) All deliverables will be considered "work made for hire" under U.S. Copyright law. Buyer will receive exclusive and complete copyrights to all work purchased. (No GPL, GNU, 3rd party components, etc. unless all copyright ramifications are explained AND AGREED TO by the buyer on the site per the coder's Seller Legal Agreement).

## Platform

Linux

C Programming Engineering Internet Marketing Java MySQL Perl PHP Python Ruby on Rails Software Architecture Software Testing

Project ID: #3541943

About the project