I need a PHP script that will scrape HTML tables from various web pages on 16 different websites, and output the results to a single PHP page, so that I can manipulate them.
I've made a basic PHP web scraper myself, but while it works correctly for most websites, it returns blank/incomplete/incorrect HTML results from these particular websites I need to scrape. So maybe some client side scraping is needed to get a proper result, but I'll leave that to you.
It's important that my IP doesn't get blacklisted by the websites I'm scraping, so the script must have time-restrictions on requests, and the script also needs to use a variety of (free, 3rd party) proxy IPs.
The URLs I need to scrape on each website are irregular, and change over time, so the script will need to start on the homepage and follow 2 or 3 links to get the correct URL. There must also be an option for me to copy/paste these URLs directly instead (to minimize requests).
I'll be running this script to scrape each webpage several times every hour every day, and it's important that it doesn't get blocked, so an important part of this project is ensuring the script doesn't get blocked by the target servers over time.
12 freelancers are bidding on average $157 for this job
Hi, I have many experience like this job. I have 6 years of experience in web scrap and web crawler. I have scrapped Gumtree,GMSarea,eaby,Amazon,etc... If u hire me, i'll do best for u. Trust me. Thank u.
Hi, I'm ready to work on "php web scraper" project. Relevant Skills web scraping Milestones 105 usd - code writing 26 usd - userfriendly interface I can achieve the results that you are asking for.