Find Jobs
Hire Freelancers

Scraping Expert for XML Sitemap Generator

$250-750 USD

Closed
Posted over 4 years ago

$250-750 USD

Paid on delivery
I would like to build an XML sitemap generator in either Python or other language that is preferred by the developer for this type of project. Here are the features I would like to have for the generator: - Pattern-matching to check for parallel pages in other languages/locale - Configurable patterns based on the site URLs - Ability to configure to crawl only specific directories - Ability to disallow from crawling parameters - Cloud-based GUI to add URL and start crawl (I can host on my VPS) - Menu to export crawl results, configure crawl URLs, disallow parameters, etc. (See Screaming Frog) - Crawl large sites up to 1,000,000 pages - Check http status codes and ensure all 200 status - Only add https URLs to sitemap and if http, check https for a page to add - Check box for adding video, images, etc. to sitemap either combined or separate sitemaps - Build sitemap index for large sites and then link off to each associated locale sitemap - Option to divide sitemap based on URL patterns (Have a certain directory or part of the site in each sitemap) - No more than 50,000 URLs per sitemap
Project ID: 20284625

About the project

14 proposals
Remote project
Active 5 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
14 freelancers are bidding on average $469 USD for this job
User Avatar
We can take your work for fulltime, as we can provide you with the dedicated react native developer for your project. We are ready to start as soon as we discuss the details. We can provide you with the quality remote work and developer would update you the task details every day. We have a team of experienced designers and developers who would provide you exactly as per the requirements. We are ready to start as soon as we discuss. We will provide you with the daily progress of the work done. Please check our freelancer profile for our past work and experience. I hope that our experience would provide you with better services saving your time. It would be great if we can discuss more details over the freelancer chat. Looking forward to your response
$500 USD in 7 days
5.0 (36 reviews)
7.0
7.0
User Avatar
Hello! I am Scraping Expert for XML Sitemap Generator developing expert and have good experiences with Android, iPhone, Mobile App Development... This project is very interesting for me and perfect fit with my skills. I am available now and can start immediately. Hope to work with you and also i am expert at Python,Linux,Web Scraping,Software Architecture,Amazon Web Services Best Regards
$400 USD in 15 days
4.8 (44 reviews)
6.4
6.4
User Avatar
Hi sir, I am expert in scrapping data and made scrappers for Amazon, eBay, Adidas, and Nike. I made successful scrappers which are running 24/7 and downloading data for my clients. I need some more information from you in order to get start this project. let me know so we can move forward. Thanks…
$500 USD in 7 days
4.8 (41 reviews)
6.2
6.2
User Avatar
‌Hi, I have gone through your requirement to scrape lots of websites. I am EXPERT in building scraping tools /scripts. Hence, I can SURELY work on your project. I am having 4 YEARS of EXPERIENCE in developing PHP-PYTHON (Scrapy, Selenium) based web scraper as well as WINDOWS BASED web scraping software through which I have crawled many sites such as Craigslist, Amazon, Yelp and many others. I have also worked on complex site to bypass CAPTCHA with the use of PROXY IP bouncing techniques.. Let's work together :) Have a great day! I am glad to see your WORK HISTORY and positive reviews of other freelancers. I am really excited to work with you and would love to have a long-term business association for any of your data related needs less  ,,,,,,,,,,,,. , ,,,,,,,,,
$555 USD in 7 days
4.9 (125 reviews)
6.2
6.2
User Avatar
Greetings, I am an experienced professional scrapper and have done similar projects in the past. Same can be verified from my profile. Let me allow to assist you with your requirements. Thanks
$500 USD in 6 days
4.8 (74 reviews)
6.3
6.3
User Avatar
Dear Customer! I have built many scrapers. This is my favorite type of job. I am absolutely confident I can complete your project easily and on time. Ready to begin immediately and finish as soon as possible. Please contact to discuss in more details. Thank you.
$500 USD in 7 days
4.5 (68 reviews)
7.0
7.0
User Avatar
Dear Sir. Glad to meet you. I'm Web developer specializing in web scraping crawling and indexing web pages. Skills: python, scrapy, selenium, requests, beautifulsoup, mechanize, lxml, urllib2, automation, bots, spiders I worked with 50+ differenct individuals/startups/companies and helped them archive their goals. Here's what you will get by working with me: * Working only on projects that I can deliver 100% * Ridiculous quality of work * Smart suggestions on increasing results/revenue and decreasing costs * Responsibility for tasks/project I work on * Reliability * Short response time * Good sense of humor ;) Hope I could awake you interest in me. Thank you for your attention. Shuaixing.(call me Shuaixing L.)
$500 USD in 7 days
5.0 (24 reviews)
6.3
6.3
User Avatar
Hi, This is Vipin.I have 6+ years of experience in customized software,web scrapping, web and mobile app development and has expertise in Android, iOS, Python, Magento, PHP, HTML, Java, Angular and Ionic framework. I would like to work on your project and looking for long term work. Kindly connect to discuss in detail and check my recent work in portfolio section as well. Hope to talk more soon Thanks
$500 USD in 7 days
4.7 (7 reviews)
5.5
5.5
User Avatar
Hi, I'm a full-stack software developer specialized in Python and PHP for the backend and Javascript for the frontend. Why do you want to use a spider/scraper to generate the sitemap? If it's your site, it should be easier to generate it from your database entries for the subpages or your url configuration. If it's necessary, it can be done this way. We can speed up the process by using the ThreadPoolExecutor from the Python standard library, so we parallelise the page loads. Get in touch on chat, so I can refine my bid. Best regards, Mice
$350 USD in 3 days
4.6 (1 review)
2.7
2.7
User Avatar
Dear Prospect Hiring Manager. Thank you for giving me a chance to bid on your project. i am a serious bidder here and i have already worked on a similar project before and can deliver as u have mentioned "I can do this job and give you an efficient job that will be very acceptable and presentable. I and my team work on web development and mobile apps and I can assure you that you will never be disappointed"
$500 USD in 7 days
1.0 (6 reviews)
2.8
2.8
User Avatar
Hi, I am a data scientist with strong skills in business intelligence, WEB scraping and data analysis tools including Python with Spark and hadoop knowledge. More than 8 years in BI and data analytics and more than 14 years in IT. Strong experience in web crawling, sales, marketing and eCommerce analytics I can let you know more about my skills in chat mode. Thank you.
$500 USD in 7 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hello Project manager I have more than 7 years of experience in Android, Iphone, Mobile Applications,Python , PHP, Ionic ,React native ,Angular JS, WORDPRESS, , HTML5,CSS, Ajax, jquery, JavaScript, Mysql, Graphic Design, Website Design, Android, Iphone and Mobile apps. Our motive is to provide high quality work and client satisfaction delivered before your deadline. Android | iPad | iPhone | Laraval I Hybrid app I Bitcoin | E-Commerce | Cryptocurrencies I MongoDB | Magento | Ionic | React JS | React Native | Angular JS I 350+ Mobile Application | 400+ Web Applications | 21+ Games My Android/iOS mobile App Experienced - Social Networking apps, mobile Ads integration Admob, - Ionic apps , Dating app, Elearning , Life Style , Quiz app , Uber Style App - Dating apps, Google Map/GPS system apps, - Chat apps, Restaurant delivery apps, Educational apps, Navigation apps - Photo / Video apps, Health / Fitness apps, - Travel apps (like ), Business Advertisement apps I am available to work full time(40~50 hours per weeks) If I work on a project, it means that I take responsibility to make it successful. Looking forward to work with you and developing a long term business relationship. Awaiting an affirmative response from your end..!!! Thanks Rahul Tech
$500 USD in 12 days
0.0 (0 reviews)
2.1
2.1

About the client

Flag of RUSSIAN FEDERATION
Novosibirsk, Russian Federation
0.0
0
Payment method verified
Member since Jul 8, 2019

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.