Create a crawler

In Progress Posted Aug 8, 2015 Paid on delivery
In Progress Paid on delivery

I have a database in MySQL. I need a PHP script that crawls this website [url removed, login to view] (which is a craislist-type website) and fill my database with all the posts from revolico.com. I will provide the list of categories and the .sql file of the database. The script has to be called every day, so the same post cannot be inserted twice in my database.

Eventually I will start crawling other similar websites as well, so if one person posted the same in two websites, I do not want to have it repeated in my database. This means the way to avoid duplicates cannot be the time inserted, the script has to detect if the post (or a very similar one) is already on the database.

Also, if the job is finished on time and running good I will re-hire the freelancer to do the other crawlers. This one is the simplest one and should not take longer than few days. Also, if you want to use another language we can discus it, as soon as it runs in a Linux box environment. Understating Spanish is a great plus, since the website to crawl is in Spanish.

English (US) Translator HTML MySQL PHP Spanish Translator

Project ID: #8233846

About the project

11 proposals Remote project Active Aug 8, 2015

Awarded to:

vxflores

I've been writing several web scrapers for freelancer mostly in PHP and Python, I have a vast experience in several programming languages and good programming practices, so I can deliver good code. I read and write Eng More

$250 USD in 3 days
(18 Reviews)
4.0

11 freelancers are bidding on average $360 for this job

expertspk

Hi, I am PHP Web Expert and can write crawler for you according to your instructions. I have built few already. Please discuss to get started. Thanks, Shahzab

$315 USD in 4 days
(136 Reviews)
6.8
raiakanksha49

am confident with your requirements. I am a PHP expert that you can trust. Let my work reach your expectation. Thanks

$263 USD in 10 days
(48 Reviews)
6.2
CurcaMarius

I can help you with this project . I have experience with Php/MySQL . Please contact me for more details.

$250 USD in 3 days
(0 Reviews)
0.0
jesusmora03

Hello i have experience in this kind of work. i'm a honest and determinated programer and i hope be helpful for you.

$555 USD in 10 days
(0 Reviews)
0.0