Customer program that pulls ALL links from a website
$30-100 USD
Completed
Posted over 14 years ago
$30-100 USD
Paid on delivery
I am in need of a simple script/program that will copy ALL internal and external links from a website.
The script must not copy relative links, they should all be full links that could be copied into an address bar and work. (therefore it also should not abbreviate or shorten the links with … or any other foreign text)
Other criteria:
-Links to be output into an Excel file named after the domain of the website (.xlsx preferred but other Excel formats acceptable)
-Script/program must be highly reliable. Many websites have upwards of 10,000 to 50,000 internal and external links (however I will NOT be copying giants like Wikipedia or ebay)
-Due to the nature of redirecting links, redirects are not expected to copy the link being redirected
-If the Excel file can be automatically filtered of duplicates and sorted by name (ie column A sorted A>Z) I would like that. However if this is a significant burden on the script, I DO NOT want this because I do not want any possible variables that could slow the script or cause it to stop midway through a link scrape.
If you can create a script that is reasonably user friendly please post your bid.