Completed

Python Scrapy ,Web Crawler, and API Expert Needed

I am looking for someone who can use Python's Scrapy and configure it to work with my account on proxycrawl.com. Here is an article they have about how to crawl data:

[login to view URL]

Here is their API doc

[login to view URL]

I am not sure if I need the Crawling API or the Scraper API, on this page: [login to view URL]

What I need:

Determine which scraper I need on that page.

There are 2 websites I need to crawl and get reviews data from them. I can provide more detail in a chat. The application does have API info for more languages than Python but I would like to stick with Python.

I need Python Scrapy expert who can configure the API to crawl and get the data I need back into a CSV for me. Ideally, I would want it to be able to crawl multiple URLs that I could have in a csv, one per line, as an input file.

Skills: Python, Scrapy, Web Scraping, Data Scraping

See more: python web crawler github, python web scraping jobs, web crawler python code, python web crawler source code, scrapy python 3, python web crawler beautifulsoup, python web crawler from scratch, web crawler in python pdf, web security expert needed, php web scraping expert needed, web crawler python 3000, python web crawler, simple input file php script web crawler, simple python web crawler, php web crawler api, python building web crawler, web album api expert, web crawler api, web crawler expert, python web crawler lines

About the Employer:
( 70 reviews ) Loveland, United States

Project ID: #24572706

Awarded to:

gangabass

I'm one of the best Python and Scrapy experts here (check my reviews) that's why I'm sure that you'll be impressed with my work. I can provide you a Scrapy spider that will work with your proxycrawl API key to use pro More

$75 USD in 1 day
(401 Reviews)
7.5

35 freelancers are bidding on average $184 for this job

chirgeo

Hi. I did read the project description and have a few questions. 1. Do you need the script as well or data only? 2. What is the format of the output data? CSV is OK? We can do other formats as well. 3. Which fields More

$200 USD in 4 days
(124 Reviews)
7.5
zekovicm

Hi there,I am Python Web Scraping expert from Bosnia & Herzegovina,Europe. I can create script in scrapy and integrate those proxies. What website would you like to scrape ? Please feel free to initiate the chat so t More

$168 USD in 4 days
(133 Reviews)
7.5
mantislin

Hi there, I am scraping expert, I have did more than 500+ scraping project, please check my feedback then you will know. Can we discuss more details about this project? then I will provide example data/script for you More

$160 USD in 5 days
(303 Reviews)
7.6
srinichal

I am an expert in scrapers and crawlers with a proven track record and expertise on this site. let's discuss further

$250 USD in 5 days
(79 Reviews)
6.8
etuannv

Hi there, I am Tuan. I am a web scraping specialist. I usually use Python3/Scrapy. I can do your project. Plz discuss more on chat. I have 5+ years’ experience at Web scraping. If you'd like to view my previous work, t More

$250 USD in 5 days
(102 Reviews)
6.8
schoudhary1553

Hello, I can help you with your project - Python Scrapy ,Web Crawler, and API Expert Needed I have gone through your job posting and become very much interested to work with you. I am an expert in this field. I have More

$220 USD in 4 days
(43 Reviews)
6.3
nisharapath

Hello, how are you? I am a python scrapping expert. This project can be completed in a day. Hope to hear more detail from you soon. Regards.

$150 USD in 1 day
(19 Reviews)
5.9
songhku925

Hi, Dear. I am very familiar with Web Scraping using Python Scrapy, Splash and Proxy. I have already completed several scraping projects on this site, so I can deliver 100% result to tight deadlines. You can see my scr More

$220 USD in 3 days
(40 Reviews)
6.0
kkc264043kkc

Can configure scrapy for website crawling. Can export data to csv file. Can fetch data through api. want to know more about the website. Can extract data from multiple urls. These are my skills related to web scraping More

$250 USD in 2 days
(55 Reviews)
6.1
liveexperts123

Hi there,I'm biddin on your project "Python Scrapy ,Web Crawler, and API Expert Needed" I have read your project description and i'm an expert in Python and machine learning therefore i can do this project for you perf More

$250 USD in 5 days
(17 Reviews)
5.9
exansoft

Hello, I'm experienced Python developer with strong expertise in web scraping using Scapy framework. Let's discuss the task in detail. Regards, Alex.

$300 USD in 7 days
(20 Reviews)
5.7
meladbadder

Hi, I am an expert in web scraping. I can do this project through my experience of the past. I worked on projects like yours. I will finish more quickly than others. i will take less than 2 days I wait for your reply, More

$150 USD in 2 days
(12 Reviews)
4.7
Programmer59

Hello Sir, I am professional Python Scraper with having more than 5 year's experience in this field. I read your project description and I am interested in it I need some more information related to your project Can we More

$300 USD in 7 days
(9 Reviews)
4.2
mrroberto

hi, i can help you. i worked with python scapy and i am crawl expert. if you interested please contact me

$344 USD in 7 days
(1 Review)
3.8
science64

Hello, I have been built differen scrapy scripts to crawl websites. I never used the site that you have montioned. If use scrapy why would be needed to use this website. IF you like I can use their API as well. I have More

$250 USD in 7 days
(14 Reviews)
3.7
ihsand

{free sample is delivered} Greetings, My expertise: 1. Python 2. Scrapy 3. Proxy rotation 4. Scraping using regex, DOM 5. API integration over python urllib (no extra libraries) Let's Talk Ihsan

$150 USD in 7 days
(5 Reviews)
3.3
dev7fares

Hello my name is Fares, I can get it done perfectly as you want let's chat when you are online, Thanks

$140 USD in 7 days
(9 Reviews)
2.8
benliao

Dear Sir/Madam I can provide you perfect work as you looking for. I have rich experience about python, PHP,C# and I have major about Web scraping,Crawling,MYSQL, Django etc. we can discuss more in chat . I will be wai More

$140 USD in 7 days
(2 Reviews)
2.4
arassolenko

I am senior Sorftware Developer with full experience of 5 years. I have done many web scraping projects using Beautiful soup, Selenium, Data Mining and Python.. If you want, I can provide examples. I will wait for your More

$100 USD in 2 days
(3 Reviews)
2.5
zoranzdravkovic2

-------- Senior Python0/ Web Scraping/ Scrapy/ Data Scraping Expert! -------- Hi,dear Your project is very attracting my mind because I'm very mastered in these branches and also, have rich experiences and high skills More

$100 USD in 7 days
(4 Reviews)
2.0