Desarrollar software

$30-250 USD

In Progress

Posted

almost 8 years ago

$30-250 USD

Paid on delivery

-I need a web crawler, paid or free, that can crawl through websites collecting RTMP Urls (for example: rtmp://[login to view URL]:channel2_800) and filtering out certain keywords such as "SWFUrl " or "RTMPE" (protected streams) inside such URLs, to avoid collecting useless URLs. -I need the web crawler to accept a list of websites as input. -If possible I also need it to check whether the streams are alive or dead. -I am looking for the most powerful and best working one I can find. If you know or have previously built such web crawler, please contact me with the relevant information about it. I don't want to start this project from scratch. Thanks

Python

Software Architecture

Web Scraping

Project ID: 10607680

About the project

2 proposals

Remote project

Active 8 yrs ago

Looking to make some money?

Email address

Benefits of bidding on Freelancer

Set your budget and timeframe

Get paid for your work

Outline your proposal

It's free to sign up and bid on jobs

Awarded to:

@mwarrenschultz

Hello. I can create the rtmp scraper/crawler you have described using Python 2.7. I will also use the libraries Mechanize, Selenium, and BeautifulSoup, which are all quite powerful scraping libraries. I can also add the ability to test for live feeds, as well as filtering as you requested. Please contact me so that we may speak further.

$155 USD in 3 days

4.9

(39 reviews)

6.2

2 freelancers are bidding on average $166 USD for this job

@flashsaiful

Web scraping expert I use python language. My scripts works on windows, mac or linux, but linux is preferably. I can schedule scripts on server if it is required. I have more 100 finished projects (google scraping, facebook scraping, yellow pages, linkedinIn, amazon, webshops and other sites with lists of any items). I can scrape secured and protected sites, my crawlers can enter into login form, emulate ajax requests etc. If site block IP i can use proxy or TOR. I can try avoid captha on site in avtomatic or manual mode. I can export data into json, xml, csv (excel), or any database (mysql, mongodb, mssql, etc). I can develop web-interface for management running script (start, stop, etc), using PHP, HTML, JS.

$177 USD in 3 days