Create a Web Scrapping Program

We want a program that scrapes/extract data from various websites. The program will go to [url removed, login to view] and then put various search inquires (Accounting textbooks, Law textbooks, Chemistry textbooks, Biology textbooks, ETC) and search. Next it will look at the used price of the book. If the price of the book is greater than $40 then it should click on the link and extract the ISBN number. If it is less than $40 then the program should move on to the next book. It will continue this process until it reaches the end of the books/searches and put the information in an excel file. The program will then use the ISBN numbers (in the excel file) to go to [url removed, login to view] and use the ISBN numbers one by one to search the prices for the books. Also, when the program is searching the ISBN numbers on [url removed, login to view] it should uncheck all of the options on the left side except New and Used. Next, the program will look at the lowest price and check the merchant/website. If the website is "Amazon" or "[url removed, login to view]" then it will cancel the search and move on to the next ISBN number in the excel file. If it is not "Amazon" or "[url removed, login to view]" then it will check the condition of the lowest price book and if the condition is "brand new, new, like new, mint, very good, or good" then the program should move on to the seller's comments available below the condition in the same section (If the condition does not match then it should move on to the next result). However when the program is extracting the comments it should look for specific words in the description and if they are present then the program should move on to the next search result and repeat the process. If the next one is good (does not contain "blacklisted words") then the program should extract the information (price, website/bookstore, condition, and the seller's comments) and then put the information in the same excel file as the ISBN numbers. This is the whole process but the program interface should be made as follows: The program should be extremely simple. It should consist of 2 options. One option should be to search all subjects (biology, accounting, etc). We will provide you with a list of subjects for the program to search and also a text file with the "blacklisted words". The program will put the information from each of the subjects into the previously mentioned excel file. The second option should be to search specific subjects. If we select the 2nd option then a dialog box will open on the program which will allow us to input the subjects that we would like to search. The program will then put the extracted information in individual tabs of the excel file. For each of the subjects the program will extract all of the ISBN numbers from Amazon and the information for each of the ISBN numbers. The program will also consist of a button to run the program. I understand that the description seems complex but it is much simpler than it sounds. Please feel free to ask any questions you may have.

Skills: Data Mining, Perl, PHP, Software Architecture, Web Scraping

See more: web side create free, web scrapping c#, subjects in accounting, software used to create websites, search the web for sounds, searching the web, searching program in c, search for books by isbn number, program used to create websites, half price books, free web accounting, free data input software, free accounting questions, free accounting in excel, free accounting books, create web free, create free websites search, create free websites, create free web, create a free website with php, create a free website like i want, create a free web, ask web search, ask com web search, ask accounting questions free

About the Employer:
( 0 reviews ) United States

Project ID: #5231171

22 freelancers are bidding on average $286 for this job


Dear Client, I can help in your project. We have already experience of working on similar projects. Please see below to get idea of our experience: Amazon/Ebay Bots: [login to view URL] More

$206 USD in 5 days
(255 Reviews)

I am an expert in delivering scrapers and willing to discuss further details about the project specifications and needs

$315 USD in 8 days
(131 Reviews)

Hi Ye, the requirements can be more simple if you use screenshots. This will make every thing easy in verification. I could provide a desktop application in C#. Let me know if you are interested. Thanks

$263 USD in 1 day
(122 Reviews)

HI, i have developed similar bots for searching DVD . And you can see my profile for many amazon bots . i can best perform this job as i already have much skills regarding this. Thank you

$210 USD in 6 days
(62 Reviews)

Dear Sir, I'm very much delighted to let you know that i did data scraping with PHP-cURL from many sites. I just scraped the data from web site and then wrote the data in mysql database or excel or csv or xml file. More

$250 USD in 3 days
(30 Reviews)

Hi, This seems to be an interesting project. I think I can demonstrate results from an working prototype if you request. Thanks

$250 USD in 3 days
(65 Reviews)

This bid is for a Windows program that does what you want. My bid includes the program's source code (written in C3 or Delphi, whichever you like better), 2 years of free tech support and your first good review on this More

$188 USD in 3 days
(43 Reviews)

Hi Sir, I am a lead programmer as i have 10 years of working experience in php,mysql,ajax, jquery, javascript, css, html, Graphics Design. I am a lead developer with a team of developers and designers. I have expe More

$360 USD in 10 days
(14 Reviews)

Hi I have read your project requirements and created a demo spider for your view. It searches eBay for Used Chemistry textbooks within the range of $0 to $40 then extracts there name and [login to view URL] it searches direc More

$222 USD in 15 days
(29 Reviews)

I've a very good experience in this field and can get this job done easily and if you interested in my bid we can make a conversation.

$166 USD in 3 days
(2 Reviews)

Hi. I have read the description of your project and I am interested. I already have a 1000$ internet automating and scraping robot software which I can use in your software. I can even make the software solve 5000 cha More

$1263 USD in 30 days
(10 Reviews)

Greetings We would like to discuss in more details before placing a confirm bid. Let us know if you have some time to chat on Freelancer. Awaiting to hear from you,Have done similar work to your requirements in the More

$500 USD in 4 days
(17 Reviews)

Hello, I have done various kind of web scrapping, web form filling, data parsing and other type jobs with great success by own developed scripts/tools/software. I can deliver high quality work and able to meet stron More

$200 USD in 3 days
(12 Reviews)

Hi Bagasraib! I have created a quick example or scraping books from amazon with price over $40 and getting ISBN for each of them. Check it out [login to view URL] More

$222 USD in 10 days
(5 Reviews)

Hi, i can dot this job in less time. Ready to start. Waiting for your response. I understand overall working flow. I will implement this by using iframe,javascript,jquery and php. Thanks, Ali Nawaz Hiraj

$388 USD in 3 days
(9 Reviews)

Hi, I have 5+ years of experience in amazon,i done lot of amazon jobs before,i done 5 tools recently for amazon, please check my amazon jobs in my profile please check my profile i sucessfully completed 10 amazon More

$333 USD in 7 days
(2 Reviews)

Hi, I have seen your requirements, we can do it. Already we have done lots of projects similar to your requirements. Please make us to confirm so we can start work on your requirements. Ms. Rani

$194 USD in 3 days
(4 Reviews)

Non hai ancora fornito una proposta

$200 USD in 10 days
(4 Reviews)

I AM CERTAIN THAT I CAN DO THIS!!! I'll start by saying that, since I am sure that is what you really want to know. I have a Master's degree in Computer Science, as well as over four years of professional programming e More

$144 USD in 7 days
(3 Reviews)

I have done some web scraping stuff and I can do this [login to view URL] can be done in java with GUI also(if insisted).

$111 USD in 5 days
(2 Reviews)