Closed

PHP Web Scraper - 21/01/2018 18:24 EST

I need a PHP script that will scrape HTML tables from various web pages on 16 different websites, and output the results to a single PHP page, so that I can manipulate them.

I've made a basic PHP web scraper myself, but while it works correctly for most websites, it returns blank/incomplete/incorrect HTML results from these particular websites I need to scrape. So maybe some client side scraping is needed to get a proper result, but I'll leave that to you.

It's important that my IP doesn't get blacklisted by the websites I'm scraping, so the script must have time-restrictions on requests, and the script also needs to use a variety of (free, 3rd party) proxy IPs.

The URLs I need to scrape on each website are irregular, and change over time, so the script will need to start on the homepage and follow 2 or 3 links to get the correct URL. There must also be an option for me to copy/paste these URLs directly instead (to minimize requests).

I'll be running this script to scrape each webpage several times every hour every day, and it's important that it doesn't get blocked, so an important part of this project is ensuring the script doesn't get blocked by the target servers over time.

Skills: Javascript, MySQL, PHP, Software Architecture, Web Scraping

See more: ebay scraper php web crawler, php web scraper craigslist, web scraper data php script, php web page scraper, web scraper php script, php web scraper xml, php web bot scraper, asp php web database scraper, web scraper php, php web data scraper, sample web scraper source code php, free xml html php web scraper linux, php script web scraper, example php web scraper, php web scraper

About the Employer:
( 0 reviews ) Clarkes Hill, Australia

Project ID: #16126540

12 freelancers are bidding on average $157 for this job

Angel521

Hi, I have many experience like this job. I have 6 years of experience in web scrap and web crawler. I have scrapped Gumtree,GMSarea,eaby,Amazon,etc... If u hire me, i'll do best for u. Trust me. Thank u.

$155 AUD in 3 days
(83 Reviews)
7.3
uumarkhalid31

​I specialize in web scraping jobs like this one. You can see on my profile that I have completed many similar jobs. Don't make the mistake of hiring an amateur, who doesn't have the skill set to properly complete More

$100 AUD in 3 days
(203 Reviews)
6.8
$222 AUD in 8 days
(134 Reviews)
6.8
kawalecove

Hello Sir, I have gone through your requirement and well confident in dealing with your project in an efficient and effective manner. We have 5+ years of comprehensive experience in website development and designing a More

$200 AUD in 3 days
(55 Reviews)
6.1
$155 AUD in 3 days
(45 Reviews)
5.7
appbank888

Hi, good day. I am web scraping developer who have over 8 years of experiences. I would like to keep relationshop for a long time with you. Because it is the first project to me, I will need to show you good result More

$111 AUD in 2 days
(20 Reviews)
5.5
lvdt

Hi there, I am a professional PHP developer with a lot of experience doing web crawlers. If you don't mind, I'd prefer to start my scripts from scratch rather than modifying your scripts. I will write reusable More

$250 AUD in 3 days
(101 Reviews)
5.1
katilinas

Hi, I'm ready to work on "php web scraper" project. Relevant Skills web scraping Milestones 105 usd - code writing 26 usd - userfriendly interface I can achieve the results that you are asking for.

$178 AUD in 3 days
(14 Reviews)
4.4
Nada100200

Hello client. Hope you are doing well Over 9 +years experience writing almost exclusively web scraping code. I've done it all. I can scrape all LinkedIn profile My languages in order of experience and use is Python, Ja More

$30 AUD in 3 days
(7 Reviews)
4.4
mayankinnovative

A proposal has not yet been provided

$100 AUD in 3 days
(35 Reviews)
3.4
$155 AUD in 3 days
(1 Review)
0.6
MikeMusni

Please pass me the URLs and I will make a page where you can view the table. If you like the result of the page, then we are ok to resume the project.

$222 AUD in 3 days
(1 Review)
0.4