Need Python Program to Check if Url Exist or Not

$10-30 USD

In Progress

Posted

over 4 years ago

$10-30 USD

Paid on delivery

I need a python program or script to check if the url exist or not. There will be two files one with domain list in txt file and other with the url path. I need python program to first check whether the domain is live or not then check the url path if it exist. And if exist save the full url to a file. I have huge domain and path to check so need multithread or faster python script to do so.

Python

Software Architecture

PHP

Linux

Project ID: 21914406

About the project

2 proposals

Remote project

Active 5 yrs ago

Looking to make some money?

Email address

Benefits of bidding on Freelancer

Set your budget and timeframe

Get paid for your work

Outline your proposal

It's free to sign up and bid on jobs

2 freelancers are bidding on average $28 USD for this job

@smsaurabhv

Hi, I have gone through your requirement to scrape lots of websites. I am EXPERT in building scraping tools /scripts. Hence, I can SURELY work on your project. I am having 4 YEARS of EXPERIENCE in developing PHP-PYTHON (Scrapy, Selenium) based web scraper as well as WINDOWS BASED web scraping software through which I have crawled many sites such as Craigslist, Amazon, Yelp and many others. I have also worked on complex site to bypass CAPTCHA with the use of PROXY IP bouncing techniques.. Let's work together :) Have a great day! I am glad to see your WORK HISTORY and positive reviews of other freelancers. I am really excited to work with you and would love to have a long-term business association for any of your data related needs less ,,,,,,, , ,

$30 USD in 3 days