Scraper bots

$250-750 USD

Completed

Posted

almost 8 years ago

$250-750 USD

Paid on delivery

Needed: Scraper for various room rental places around UC Berkeley: - Location: California 94720 + 2 miles - Include your Estimate PER website (below) - Populate MySQL DB: Fields -- Posting Name (if different from address) -- Posting Address -- Posting seperate URL -- Date last checked -- Property Description -- Picures (only <img src=""> urls) -- Misc if available: Rooms, Bathrooms, Type (studio, 1bedrrom, 2 bedrrom), other - bonus (mention cost price seperately) Develop WordPress Module -- Place posting in "Pending" items: /wp-admin/[login to view URL] - Any technology is permitted (scrapy, selenium, CasperJS, other) however with a valid reason why doing so. - More information upon accepting the job This script has to run every 1 hour (Crontab), and modular build, in the sense that every scraper is their own specific script. We will be adding more scrapers and data analytics continuously. Good code will be rewarded by continuous projects from our end. - Websites: --- Craigslist: -------------------------- [login to view URL] --- AirBnB: ------------------------ [login to view URL] This might be helpful: [login to view URL] --- Sabbatical Homes ----------------------- [login to view URL],%20Berkeley,%20CA,%20United%20States

JavaScript

PHP

Python

Software Architecture

Web Scraping

Project ID: 10941078

About the project

28 proposals

Remote project

Active 8 yrs ago

Looking to make some money?

Email address

Benefits of bidding on Freelancer

Set your budget and timeframe

Get paid for your work

Outline your proposal

It's free to sign up and bid on jobs

Awarded to:

@olegksl

Hi, I can develop this, please see my feedback have great experience in this, Have a good day, Oleg

$250 USD in 3 days

5.0

(130 reviews)

6.1

28 freelancers are bidding on average $549 USD for this job

@Shopify

I want to discuss this project with you further, let me know the best suitable time for you to schedule the meeting, Feel free to message me at any time, i used to be online 14 hrs in a day on this website so probably you will get a quick response from my end.

$773 USD in 20 days

5.0

(15 reviews)

6.7

@shengui

Hi.. I am very interested in your project, because I am an expert in C/C++, C#, php, asp.net, web scraping, web automation, selenium and others. Please contact me, then we can discuss about the details and the price. And I am free in recent days, so I can do my best for your project. Thanks.

$555 USD in 7 days

4.9

(104 reviews)

7.1

@mike199

My name is Mike and I’m from UK. I work with individual clients and also provide outsourcing services for a number of UK and USA based agencies. Your project description sounds interesting to me and I do have skills & experience that are required to complete this project. I can show you some examples of my work. Please contact me to discuss your project.

$683 USD in 10 days

4.9

(43 reviews)

6.8

@kalpataru44

Hello, I am kalpataru, a freelance expert developer and have specialized in bot, scraper, automation software, custom browser and chrome extension development. I have 5+ years of experiences in software development. I have developed many such programs before. Feel free to ask me if you have any query. Thank you. Please a take look at few of my completed projects here. https://www.freelancer.in/u/kalpataru44.html

$666 USD in 5 days

4.9

(51 reviews)

6.3

@mwarrenschultz

Hello! I am a professional programmer with many years of web scraping experience using Python. I have read your project description, and I can create the 3 web scraping programs you have described. To do so, I will use the libraries Mechanize (for web automation tools), BeautifulSoup (for parsing html), and Selenium (for working with AJAX or Javascript, if necessary). I have written very similar programs in the past, and I would be happy to show examples. Please contact me so we may speak further and so I can send files. Thank you for your consideration.

$444 USD in 10 days

4.9

(44 reviews)

6.2

@mananraja

Hi there, I have read the project & would like to discuss.. I can scrape data from websites using Python scripts.. I have good web scraping reviews for my past projects.. Hope to hear from you..

$250 USD in 2 days

5.0

(94 reviews)

5.9

@desindev

Hi. I have done multiple scrapers with check my reviews (5/5 rating) on all scrapers. .

$500 USD in 14 days

4.9

(28 reviews)

5.5

@M5L2764K

Hi, I have a lot of experience writing scrapers in Python Scrapy framework and I have written many for online shops and hotel/restaurant reviews. I helped to manage hundreds of scrapers running on 3 servers. I also have experience with avoiding IP bans, I'm the author of popular proxy extension for Scrapy. I can write scrapers for you using Scrapy because it allows to reuse "pipelines" (storing data to a database in this case).

$288 USD in 5 days

5.0

(20 reviews)

5.4

@lillysoft

Sir i am really interested in your project . sir i am an expert of software and web scraper and bot development. i have already developed many web bots and scraper similar to your project . you can check my portfolios and my previous projects . so i can finish you job faster and with best quality at lowest cost . so please feel free for contacting me i am waiting for you response.

$288 USD in 3 days

4.9

(18 reviews)

5.2

@sheratsuki

i'm software engineer. i have done project similar to this a lot of time before. bot that crawl web and auto signup & post , send data, scrape data. contact me as soon as possible. i'm available on skype. in can show you demo now.

$750 USD in 30 days

4.7

(16 reviews)

4.5

@marketiplace

I got 7+years work experience in Data Collection,Bulk Email Campaign,Excel VBA and Internet Research in IT companies here.I can do create crawler and scrap datas from using C++,Python and Perl coding as per your requirements in excel with multiple ip rotations.I have dealt with US,UK and Australia companies President,Directors and Managers for web design and development projects successfully and I have Good Communication with writing skills.I am well versed in Internet,MS Office Applications and Phone Etiquette manners with latest Technologies.I can accept your payment terms.

$333 USD in 4 days

3.7

(8 reviews)

4.5

@shubhaa20

I have worked on scrapping project earlier, which involved scrapping of the credit cards reward point. I will be able to do the scrapping of the hotels with one scrapper per site. I can write the code such that it can schedule the scrapping task of its own and also remove duplicate data which it obtain from the scrapped data. The scrapping will be written in such a way that the scrapped data will not be instantly updated in db instead. The data would be written into an offline file and then uploaded to data using another bulk upload program. This will ensure that the scrapper is busy in extraction without caring about the upload to db and that will be handled by separate job. Thus increasing the efficiency. Please contact me for further discussion and understanding.

$666 USD in 10 days

5.0

(3 reviews)

2.6

@zubairalamjmi

All 3 websites are of same complexity and will require same approach to make their crawlers, they will likely differ in their anti-bot approach. So i've quoted them all as one. Though each website will have separate crawlers. I extract data in a very detailed and more usable form. Crawlers are made in a comprehensive way that it takes care of many corner cases for a particular website. I've written crawlers for very large websites with very anit-bot strategies. My fullstack technologies skills help me to write these crawlers in more efficient way. I'll use selenium, python, scrapy, a proxy serivce, an aws or similar server instance Quote for data import into woocommerce (separate from crawlers): USD 200 It will take minimum of 10 days.

$700 USD in 10 days

0.0

(0 reviews)

0.0

@Ronak26361

A proposal has not yet been provided

$250 USD in 7 days

0.0

(0 reviews)

0.0

@riaanfv

Good day to you. I am eager to help you with your project because this is the type of work I am very good at. I have completed a few jobs successfully on Freelancer so far, with excellent reviews. If you view my profile you will see that I am perfect for this job I have more than enough experience outside of Freelancer at Upwork and Guru to guarantee your satisfaction. Thank you for your time, AND get your work done by me

$665 USD in 14 days