Find Jobs
Hire Freelancers

Scrapy: Securely scraping data from secure sites/servers into csv

€8-30 EUR

Closed
Posted over 3 years ago

€8-30 EUR

Paid on delivery
This is for a scraping project of e-commerce products to create a CSV catalogue file of all items with precise data to be scrapped. You must have experience with Scrapy. If asked you must be able to provide some proofs ( screenshots of past scrapy /python raw code from your end ). The spider MUST crawl discreetly / securely / politely : you MUST make use of maximum secure way of running it such as using proxy / delayed crawler / user-agent techniques / and all the best practices and such. The targeted websites to crawl and extract data are secure. They have anti-bot measures implemented and complex anti-scraping technologies( Ajax / Javascript , maybe honey-pot traps , maybe captchas, and probably more ) . Each data on product page that must be extracted into CSV file is : - the parent category of the product = the category it is part of - title of the product - price of product - description of the product - possibly some other data needed after agreement The deliverables : - every file of the project ( spider(s) , items file, settings and config , all .py files, and all other files ) . - Must comment - at least the most important - parts of your code : what it does. - Explanation how to run it securely daily / automatically ( server Apache2 , Linux Ubuntu 16.4 ) without being banned / blocked from targeted website. - Dev should write clear / bug-free code that works in the long-run ( over long period f time ).
Project ID: 26449792

About the project

8 proposals
Remote project
Active 4 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
8 freelancers are bidding on average €93 EUR for this job
User Avatar
Nice to meet you. Thanks a lot for taking your valuable time to read my message. After readout your job description, I am very interested in your project and I believe I’m qualified for this task. I have +7 years experience in this field and have worked on many successful projects in the past. If you are looking for a highly skilled and rich experienced expert with a deep knowledge, a professional attitude, excellent communication skills and the highest code quality, then I'm the right person you are looking for. I'd like to discuss further more in details over chat with you I am so confident that my involvement in your project will bring it to a successful launch, on time and within budget. I look forward to your reply. Best Regard, Igor.
€50 EUR in 1 day
4.7 (10 reviews)
4.8
4.8
User Avatar
dear sir I am python expert work on many packages like numpy, scipy, pandas and web frameworks like flask a) Data Scientist b) Development of machine Learning Algorithms c) Sentimental Analytics of social media d) web api using Django e) Exposure on more than 3000 packages of python I myself is Developer with expert team of data scientist please initiate further for better understanding and technical discussion
€278 EUR in 5 days
4.9 (20 reviews)
4.5
4.5
User Avatar
Hi, Hope you are doing good. I have gone through your requirement and I do have skill set you are looking for. I am certified advanced RPA and QA Automation Professional. I have 2+ year of experience with Automation anywhere and successfully delivered 6 bot which are live up and running in production. I also have 10+ year of expertise in Test Automation framewrok designing with Selenium+ java , UFT + VB script and Katalon Studio. I do have very good exposure working with Web,Rest and Soap service, and also desktop based application automation. I also have hands on BDD-Cucumber,Elastic Search,Excel macros, GIT, Gradle,CI CD tools Jenkins,Cloud testing with saucelabs. We can connect and discuss more about your requirements and come up with best solutions. looking forward to working with you. Regards, Anklesh Singh
€86 EUR in 1 day
5.0 (2 reviews)
2.7
2.7
User Avatar
I have good experience in machine learning , natural language processing , deep learning using python , i am interested to give solution to the job that you have posted , i will be happy to take up this opportunity.
€19 EUR in 7 days
0.0 (0 reviews)
0.0
0.0
User Avatar
I have worked on various scraping projects and have total of 5 years of experience in the area. I have scrapped data from websites like amazon,real-estate websites, social-media websites,blogs etc. I can do this part for you and can provide the output in any file format or in any database you like. We will provide you with scripts which can be easily integrated to any existing system or that can be run independently . Please let me know of the details so that we can start with the projects.
€22 EUR in 3 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Dear client. As a python expert, I am so interested in your project. Please share more details about your requirement. I am sure I will fulfill all your requirement perfectly.
€19 EUR in 5 days
0.0 (0 reviews)
0.0
0.0

About the client

Flag of FRANCE
Aix en pce, France
0.0
0
Member since Jan 19, 2016

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.