Multi-site scraper with proxy rotation support (4 scripts 13 sites total)

Closed Posted 3 years ago Paid on delivery
Closed Paid on delivery

Project Details:

4 different company websites

Company 1 site requires: 4 sites to scrape

Company 2 site requires: 3 sites to scrape

Company 3 site requires: 4 sites to scrape (1 site has 2 tabs, another site has 6 tabs)

Company 4 site requires: 2 sites to scrape

= 13 sites total

Required Functionality:

Proxy/Socks rotation functionality for all sites

Error handling

Functionality to run multiply threaded with proxy support

Settings file

Logs

Efficient use of computer resources

Documentation of code and operation

Code operates on Windows 10/7/Server 2019

Outcome:

4 separate scripts for the 4 company sites

Web Scraping Python Golang Scrapy BeautifulSoup

Project ID: #24756946

About the project

22 proposals Remote project Active 3 years ago

22 freelancers are bidding on average $417 for this job

gangabass

I can provide you 4 separate Python (Scrapy) scraping scripts in less than 4 days for just $600. Each script will support proxy rotation, setting file, log etc. All I need to start is a detailed instruction from you fo More

$600 USD in 4 days
(447 Reviews)
7.7
chirgeo

Hi. I did read the project description and have a few questions. 1. Do you need the script as well or data only? 2. What is the format of the output data? CSV is OK? We can do other formats as well. 3. Which fields More

$600 USD in 4 days
(134 Reviews)
7.6
phpXpertbd

Dear Employer, I can use php to write 4 different scripts to scrape the different companies websites. You can run them locally or in a server. I'm expert in web scraping, web automation and data mining projects. I have More

$400 USD in 7 days
(76 Reviews)
7.4
schoudhary1553

I can help you with your project - Multi-site scraper with proxy rotation support (4 scripts 13 sites total) I have gone through your job posting and become very much interested to work with you. I am an expert in th More

$550 USD in 4 days
(61 Reviews)
6.7
meladbadder

Hi I'm an expert in web scraping. I have read your project description I can do this project for you perfectly. I still have a few questions. please leave a message so we can discuss the project. I wait for your reply, More

$250 USD in 1 day
(30 Reviews)
5.7
osmanaydin

Hello sir, Please take a look at my reviews and portfolio. I have completed web/data scraping jobs many times. I am interested in your project as well. I would like to discuss the details via pm. I look forward to hea More

$500 USD in 10 days
(51 Reviews)
5.9
FreelancerTechX

Hello, I can do all this using C# but without multi-threading. $999 with multi-threading. Kindly send me a message to discuss. Thanks & Regards, Everest Technology

$550 USD in 10 days
(36 Reviews)
5.5
saranaone

I am professional Python web scraping expert & coder. I can complete your 4 company websites scraping using Python Bs4, scrapy libraries on time with good quality results. I can configure Proxy IP rotation and run my More

$400 USD in 5 days
(94 Reviews)
5.4
GISKingStar

⭐Hello, sir. How are you? I have just read your project description and I can help you with my experiences. I have rich experience in ⭐Web scraping with Scrapy and Node puppeteer⭐. Don't waste your golden time to looki More

$305 USD in 7 days
(3 Reviews)
4.5
PKonstiantyn

Hello! I specialize in website scrapping and development and am excited for this opportunity to work with you in accomplishing your goals. I read your descriptions about 4 site requirements. Expert in both Backend and More

$250 USD in 5 days
(11 Reviews)
4.3
tinuvj

Dear Sir/Madam, I have 10+ years experience in various Web , Desktop & Mobile technologies. I can help you to scrape any complex websites. I have experience in similar projects. Please initiate chat with me for furt More

$500 USD in 8 days
(4 Reviews)
4.1
mohammedilamine

I will scrap all the site for you , and I can start immediately contact me and text me the details of your project and the exact data you want to have and in which format looking forward to work with you

$450 USD in 7 days
(1 Review)
2.2
bluehillsit

Dear concern, Hope you are doing well. I have just carefully went through your very detailed and precise job description and i understand the full scope of the job and what exactly needs to be done exactly to get the More

$305 USD in 7 days
(6 Reviews)
2.1
YankoAlexandrov

We are the one-stop provider for all your Scraping, Data Extraction, and Web Automation needs. Get a complete end-to-end solution on time and budget with full integration support.

$305 USD in 7 days
(2 Reviews)
2.6
nextaeternum

Hello, As per your job requirements I am most experienced in creating RPA Bots for scrapping data from different websites, including social networking, Apparel, and more. I have worked on scrapping content from diffe More

$500 USD in 7 days
(0 Reviews)
0.0
networkdesign17

Nice to meet you Hi I am automation expert If there is any website you need to scrape data from (no matter the format, what blocking tools there are). I can deliver the data. If you do the same thing on the internet More

$467 USD in 6 days
(0 Reviews)
0.0
lmtcba88

Ask me for a demo, FREE! > Web APPS / ANDROID APPS / DESKTOP APPS > Cryptocurrencies / Blockchain > OCR (Image recognition, Facial recognition, etc) > SCRAPING, CRAWLING > Uberization > Tracking, Geolocation > E More

$305 USD in 7 days
(0 Reviews)
0.0