Find Jobs
Hire Freelancers

Scrapy, Python Docker expert.

$15-25 USD / hour

Completed
Posted over 4 years ago

$15-25 USD / hour

We are looking to Scrapy expert to do the following; We will provide you login access to a machine. Your tasks are following using Scrapy We want to get data from a specific site and the following things need to happen 1) We go to the site then we need to search (obvious but....) - This can be partial search, a wild card or combination (like increment a number, letter combinations like abc etc.) - This is to get all the data on the site, we call this as a sitemap. 2) Then the same script should have an API class, which means if we want to update a specific record we should use reg number or something to get the latest data of that record. Since we have done the scraping in option 1. We know this unique reg number and we can pass that to the class. 3) Scrapy capture deployment dashboard, where we can see the running scripts. 4) Then use the Scrapy pipeline to load the data to MySQL. 5) You should have incorporated Selenium & Beautifulsoup with Scrapy. In short, we are looking for someone who has done all the above. We need you to give the framework, We want you to build one script. You need to transfer the knowledge to us, we have junior/mid level Python programmers, who understand all the above. We will then build individual scrapers from the framework. If you have standard libraries like extracting data from a grid, error handling. Please include. We have multiple developers in different places, so if this is built in a docker or something it would be great for deployment and replicate. We have a GitHub you can upload code to that as well. We are looking at a very capable person. Price can be negotiated. Before we award, you need to demo a system like that you have developed before. You can quote a fixed amount as well.
Project ID: 22329803

About the project

32 proposals
Remote project
Active 4 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
Awarded to:
User Avatar
Dear Company, I am Mr. Martin F., a very experienced German python developer. My daily work are scraping scripts. I integrate them into a db-backend-frontend system, so exactly what you want to be able to develop. I will provide you a sample with docs and a little tutorial by me, so your company can build such stuff in future very easily. Contact me for further questions. Regards, Martin
$20 USD in 10 days
5.0 (27 reviews)
6.0
6.0
32 freelancers are bidding on average $21 USD/hour for this job
User Avatar
I have read your project and understood. I have rich experience on python selenium scrap. I can finish your task faster than others with highest quality. I hope you are successful. Thank you in advance for your time and consideration.
$25 USD in 40 days
5.0 (23 reviews)
6.7
6.7
User Avatar
Hi there,I am Python Web Scraping expert from Bosnia & Herzegovina,Europe. I have carefully gone through with your requirements and I would like to help you with this project ! I can start immediately and finish it within the agreed deadline. Check out my profile and former clients feedback - that'll let you know everything about me. Please feel free to contact me so that we can discuss further details. Thank you for taking the time to read my proposal.I am looking forward to hearing from you. Best regards, Miljan
$25 USD in 40 days
5.0 (41 reviews)
6.6
6.6
User Avatar
Hi there, I have read your project description and i'm confident i can do this project for you perfectly.I still have a few questions. please leave a message on my chat so we can discuss the budget and deadline of the project. Thanks
$20 USD in 40 days
4.9 (56 reviews)
5.9
5.9
User Avatar
Keeping my fingers crossed for you.. I am sure of Angular.js, React.js, Vue.js, PHP, Laravel, CI, node.js, Python, Django, Flask, MySQL, MongoDB, PostgreSQL, Google Firebase, Docker, Javascript, Java, CSS, Bootstrap, HTML. Kindly do me a favor by hiring me..
$20 USD in 40 days
5.0 (13 reviews)
5.0
5.0
User Avatar
Hi there, What you are describing sound like a normal Scrapy project that uses most of Scrapy's functions. Im very familliar and keen wit Scrapy and all other Web Scraping libraries such as BS4, Requests, Selenium, and both built-in and extra libraries that might be required. I can implement a class Scraper that include functions (APIs) to its operation, which will cover all the requirements you have in the project description. Id be happy to connect with any developer to support or sync-in with the project. Please let me know more and lets discuss in chat, Pandelis
$17 USD in 40 days
4.9 (15 reviews)
5.2
5.2
User Avatar
Hi. i can do the thing you want but, selenium +Beautifulsoup + scrapy? one more for redundancy lxml well, ping me if you read this.
$22 USD in 1 day
5.0 (9 reviews)
4.6
4.6
User Avatar
Hi, Dear! I just have checked your job description. I am a website expert and have enough knowledge with PHP, javascript, CSS, HTML. Especially, Python/Django, node.js is my top skill. If u hire me, u will get a good freelancer. I'd like to work with you. Best regards.
$20 USD in 40 days
5.0 (4 reviews)
2.9
2.9
User Avatar
Hello, Please contact me and have a great building on your ideas to reality. I have rich experience in those fields. Thank you!
$20 USD in 40 days
4.9 (3 reviews)
2.6
2.6
User Avatar
Hello I am a python scraping expert My highly skilled and experienced expertise can implement a project of any complexity. Tell me about your idea, preferences and wishes. And I'll help you to fulfill your dream! I will provide consistent passionate attitude and high speed with qualified work to get your dream. Please feel free to contact me. Looking forward to working with you. Best regards.
$20 USD in 40 days
4.9 (2 reviews)
2.4
2.4
User Avatar
Hello! Me and my team can deliver your tasks with great quality We have high experience in Web Development, specifically in Python development. We have developed more than 1000 projects . Currently developing mostly in Laravel + VueJs SPA for apps and WordPress + Elementor for Cms. You can check some references in my profile. Please check my profile and message me for more details. Thank you
$40 USD in 40 days
5.0 (3 reviews)
1.4
1.4
User Avatar
Dear sir! Thanks for your posting job! I read your job description carefully, so I'd like to join your project as Scraphy expert. I have rich experience of developing data scrapping based on Python script. Also I'm master in dom management for scrapping. I think I can support wonderful and perfect script to you for above items. I'd like to discuss more with you. Best regards!
$20 USD in 40 days
5.0 (1 review)
0.6
0.6
User Avatar
Hi, I can assure you to accomplish your” Web & App development project” with quality work in the least amount of time. Although I am very sure about your requirement but still I would like to ask few question before we proceed ahead – Do you have prepared wireframe/Functional requirement to proceed accordingly? Will you provide me API/Plugin which is required for this project? Is there any timeline to launch this project? Please come over chat and suggest me the next step to proceed further. Thanks AS
$20 USD in 40 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hello, We have 6+ years of experienced full-stack (Python, Django, Machine learning, Anaconda) developers team for your existing website projects. Also We have 8+ years of experienced JavaScript MEAN/MERN stack developers Team for your project. We are expert in Python website and apps development, Python programming, Python integration framework, designing, etc. We are familiar to work with GIT, cloud-based services and extensive experience in Python3, Flask, SQLite, HTML5, CSS3, Bootstrap, JavaScript & jQuery development. We've pursued projects on technologies including Python, Django, Pyramid, Plone PostgreSQL, MySQL, HTML5, CSS3, JS, PHP, Flask, Machine learning, Tensorflow, Keras, Turicreate, Pytorch, AI, Rest frame work, Chatbot, Automation, Beautifulsoup, Scrapy, Selenium, Python requests, AWS, NGINX, Pyspark, Trading bot, Numpy, RestAPI etc. Python development services: • Web development and test automation • Google App Engine Cloud Platform development • Zope and Plone development • Django development • Pyramid framework development Kindly initiate the chat i.e we can discuss further. Thanks! Emizentech
$15 USD in 40 days
0.0 (0 reviews)
0.0
0.0
User Avatar
I am a python developer very familiar with web scraping, selenium, data extraction and mysql. I also know Docker very well. I would be available to help you on an ongoing basis
$15 USD in 20 days
0.0 (0 reviews)
0.0
0.0

About the client

Flag of PORTUGAL
Maia, Portugal
5.0
24
Payment method verified
Member since Apr 22, 2004

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.