Find Jobs
Hire Freelancers

Build a ruby scraper to supplement a MySQL product database

$250-750 AUD

Completed
Posted about 8 years ago

$250-750 AUD

Paid on delivery
Stagecoach Software Pty Ltd is developing a website to contain statistical profiles of a particular industry in Australia. Our stack is Ruby on Rails 4.2, Ruby 2.2, Passenger 4 and MySQL 5.5. We run a 3 server configuration on Engine Yard with dedicated instances for our db, web app and utilities. Our database receives about 30,000 new rows per day through scraping operations (22 different scrapers using nokogiri). Presently our app instance only provides admin operations; the consumer front end is under development. Currently our team comprises 3 backend ruby developers and 1 front end developer. We have about 16 M products in our database. Each product has a distinct id number and name. Each product has 4 types of characteristics which we wish to record. Our database is incomplete. We need a ruby scraper built to look up a particular website and record these characteristics to our database for about 11 M products where they are missing. The code will probably take several days to develop and may take several weeks to run. The running of the code must be monitored during that time. Multiple instances must be run to minimize the completion time. All code must be developed locally and periodically uploaded to a github branch before being approved by the senior developer for merge and deployment. Bidders are invited to set out a summary of their methodology. This is one of a pipeline of projects in this enterprise. Further ruby projects will be available if the above tasks are carried out well. Applications from a freelancer experienced with Engine Yard and chef are particularly welcomed.
Project ID: 9862978

About the project

3 proposals
Remote project
Active 8 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
Awarded to:
User Avatar
$660 AUD in 3 days
5.0 (7 reviews)
5.4
5.4
3 freelancers are bidding on average $673 AUD for this job
User Avatar
Dear, When I read this job I feel very excited to be a part of your project and share my great experience in software development. I worked as developer with team members in big projects developers. I know thorough how to start, develop and maintain website. Everything you mentioned above I have been using more than 4+ years: - I have experience in developing the application like you want with Scrapping, i can do this job very well. - I designed and developed DB using MongoDB, Postgres, MySQL and Sqlite. - Ruby, Is the best Platform for develop these type of application. - I like your choose of Amazon Hosting Server with AWS S3 Storage, etc. Also I worked with Google and Microsoft Azure; - I work on MAC, Ubuntu, Window and have experience to setup RedHat and Ubuntu for Apache, Nginx, Unicorn and TomCat hosting web sites. - I have good server deployment knowledge into various server hosting Plateform i.e. Digital Ocean, AWS EC2, AWS Load balancing, Elasic Beanstalk, Bluehost, Site5, Hostgator, Heroku e.t.c As you need to launch this project in a short period, I can work more than 50hr/w. I confirm that if you hire me I can launch this project in time and with high quality. I never give up and do the best. As you work remotely, so the best option is to use Google Doc for simple QA tracking and Trello for tasks management. I worked remotely as a developer , so know how to do this effectively. Waiting hearing from you. It was nice to apply for this job. Thank you
$777 AUD in 10 days
4.9 (16 reviews)
5.7
5.7

About the client

Flag of AUSTRALIA
Idalia, Australia
5.0
57
Payment method verified
Member since Feb 25, 2013

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.