Data Scraping software development

New program from scratch Description of every module: On one side we have a list of about 10,000 listing type of websites with certain data sets. On the other side, we have customers base to which we want to give the opportunity to search these data sets through our own website. In user interface user could input query values and get the relevant data sets. Description of requirements/functionality: We know there are at least two ways to do this. But before we give you the project we want to know if you can do it. And do it in the way so that software performs fast and precisely. You can separate software in several modules or use a mix of available tools, up to you. Please describe to us the logic steps and the main components of the solution that you would make to solve this problem. As you can imagine the listing layout and types differ. Some are descriptive and some are with main details only. The software has to be smart enough to work with different types of information and extract the essential parts precisely. All values in drop down input fields would be provided by us. Default selection would be "All" and for numeric values it would be "Any" range by default if user doesn't enter any value. CMS and Admin requirements: Software code has to be well organized and editable. Input queries must be easy to add or delete. Also, the relation between search queries must be modifiable (And/Or/include/Exclude relationship) Specific technologies required: up to you, but may include Hadoop, noSQL, NLP ect Please read thee job completely before you apply Also your proposal must include the details step by step of your process and what (how)you will do etc. I will ignore the proposals which are just copy paste standard proposal notes!!!******