Data Scrap

A taylor made web base application to crawl and scrap data from listing and save into mySQL database: Functions required: - able to crawl 2 target websites (different data presentation/layout but same concept) and retrieve required data of target website (dynamic pages) into our database (approximately 15-20 fields, you should be able to design a database table structure to avoid redundancy and promote faster search by various fields), on pre-set interval, eg per day, per month etc. (able to ignore existing lines by certain fields) - our admin is able to search created database by various fields filter and present in our specified layout, in pages. page per line can be altered anytime according to admin (eg 50,100,200 results per page) - Statistic page to show data in bar chart, fields filter can be freely specified by admin. Some fields (or all) shall be able to be sorted acesending/decending - every search result can be printed in pre-designed "print friendly" format - our admin should be able to update data manually - our admin shall be able to back up/export the entire database (or by selected field) in text base file format - front end presentation page shall facilitate 2 languages. (you only need to do one language, with button to switch language. We will translate and place content in other language place holder) You should be experienced in busy Database design (SQL, Normalization) and web front/back end development and web base data crawling/scraping. This is just a database part of the project (about 1/5 of the entire project). It will be extended with extra sales & marketing functions, automated mailing function, membership function, administration function, feedback, forum, mobile app etc. Prompt and efficient development will secure future extension work of the project.