Database scraping/creation.

I'm looking for various databases for a new project. My first project request, be gentle... I will supply various subjects/themes and would like databases delivered on those particular areas (general, easily available information from around internet). There are various 'scraping' methods out there which I have experimented with that can be used. Hopefully you are an expert in this area. It may be best to bid on a price per database. When bidding, please put a ROUGH average on the amount of fields in the database you will be supplying. If possible, please also supply an example database before bidding. Thank you, and feel free to post/contact me for clarification etc. before bidding. Thank you. ## Deliverables 1) Complete and fully-functional working program(s) in executable form as well as complete source code of all work done. 2) Deliverables must be in ready-to-run condition, as follows (depending on the nature of the deliverables): a) For web sites or other server-side deliverables intended to only ever exist in one place in the Buyer's environment--Deliverables must be installed by the Worker in ready-to-run condition in the Buyer's environment. b) For all others including desktop software or software the buyer intends to distribute: A software installation package that will install the software in ready-to-run condition on the platform(s) specified in this bid request. 3) All deliverables will be considered "work made for hire" under U.S. Copyright law. Buyer will receive exclusive and complete copyrights to all work purchased. (No GPL, GNU, 3rd party components, etc. unless all copyright ramifications are explained AND AGREED TO by the buyer on the site per the worker's Worker Legal Agreement). * * *This broadcast message was sent to all bidders on Saturday Apr 10, 2010 6:27:07 PM: I've made this as a bulk reply to everybody who has responded so far to this (amazing amount of interest, thank you!): Sorry for being so vague on the request. To give a more detailed idea of my requirements, I would like an 'average' price to scrape a website for me. This would mean extracting as many fields as possible from that website and supplying in .csv, .txt (TAB delimited) or .sql (MYSQL). I have used various tools over the last week to scrape, into database format, a number of websites myself. Although I have been successful, I found my lack of html (especially regex) knowledge made it more time consuming than it should have been. Knowing how these various tools now work, I'm hoping setting one of these various methods up would be very easy for somebody who knows what they are doing. So, I'm after a bid to scrape one average website for me. Please bear in mind that although initially I will have one or two sites scrapped as a test, I will then hopefully be giving the successful bidder more and more sites to do (this might amount to quite a lot!). I also realise that if a website is more than 'average', the price can be altered accordingly... Again, thanks, and if you need any more info, please let me know. ## Platform Supplied in: CSV (.csv) TAB delimited (.txt) MYSQL queries (.sql)