Find Jobs
Hire Freelancers

Create batch

$10-30 USD

In Progress
Posted almost 8 years ago

$10-30 USD

Paid on delivery
I need to get all the urls contained in sitemaps. batch file (.sh) to be used for this purpose. Searches for Sitemap entries in the [login to view URL] and parses those files Sitemap can be 1. XML containing list of urls 2. XML containing list of sitemaps 3. GZ compressed file containing list of sitemaps (xml or gz) input: file containing domain urls output: files categorized by domain containing list of urls so far here is what i have done, this ain't programming but I'm sure you could find 1 usefull info in here: wget -O - [login to view URL] | grep -Po 'http(s?)://[^ \"()\<>]*sitemap[^ \"()\<>]*' > example cat example | while read -r line ; do wget $line ;done gunzip * ls | while read -r line ; do grep -Po 'http(s?)://[^ \"()\<>]*sitemap[^ \"()\<>]*' $line; done > sm cat sm | while read -r line ; do wget $line ;done
Project ID: 10284609

About the project

1 proposal
Remote project
Active 8 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
1 freelancer is bidding on average $30 USD for this job
User Avatar
Even though I am new to freelancing, I have 7 years of experience in the field of programming. I work in an embedded company, where writing scripts is a common practice, I will finish the work within given time frame and with the great quality, looking forward to working with you Thanks, Avinash
$30 USD in 1 day
0.0 (0 reviews)
0.0
0.0

About the client

Flag of CZECH REPUBLIC
Brno, Czech Republic
5.0
11
Payment method verified
Member since May 22, 2011

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.