Break down HTML pages by Header and associated text

$30-250 USD

Completed

Posted

about 4 years ago

$30-250 USD

Paid on delivery

I need a program that: 1) Accepts a list of one or more (up to 1000) top level domains from a .txt file (one TLD per line) list the 2) Spiders the home page fromt he TLD in the list to generate a partial sitemap for that domain a) nothing that requires a login or transaction b) just the pages that link directly to the hope page 3) Creates a report in .csv format that contains the following a) URL b) Header Level c) Header Text d) Text immediately before header. Must allow null because the first Header won't have a paragraph before e) Text immediately after header. Must allow null because the last Header on a page won't have a paragraph after The program should be triggerable from a web page, where the .txt file containing the list of top level domains can be specified through a "choose file" mechanism, and a "download results" button should appear when the program is finished running Don't care what behind the scenes programming language is used to perform the spidering or sound check. DO care that the results are accurate Input file [login to view URL] [login to view URL] [login to view URL] [login to view URL] [login to view URL] [login to view URL] [login to view URL] [login to view URL] [login to view URL] [login to view URL] etrade [login to view URL] [login to view URL] [login to view URL] [login to view URL] [login to view URL] [login to view URL] [login to view URL] [login to view URL] [login to view URL] [login to view URL] [login to view URL] [login to view URL] [login to view URL] [login to view URL] [login to view URL] [login to view URL] [login to view URL] [login to view URL] [login to view URL] [login to view URL] Output example: [login to view URL], H2, "Stay at home", null, "only go outside for food, health reasons or work (but only if you cannot work from home" [login to view URL], H1, "Welcome to [login to view URL]", null, "best place to find government services and information" ...

HTML

JavaScript

Software Architecture

Python

Project ID: 24629356

About the project

26 proposals

Remote project

Active 4 yrs ago

Looking to make some money?

Email address

Benefits of bidding on Freelancer

Set your budget and timeframe

Get paid for your work

Outline your proposal

It's free to sign up and bid on jobs

Awarded to:

@w4po

⭐ Hello, Sheri⭐ I can do this easily, I'll automate this job, Cost is $100 in Less than 3 days (maybe ~12 hours), My previous work below: ///// This is a video to demonstrate Process automation, programmed way Of a manual fetching of LinkedIn URLs from a variety of sites. Video: [login to view URL] ///// Memsource job catcher: a tool that login to Memsource and click on projects and waits for new jobs to come, Accept them right away. Video: [login to view URL] ///// Real Estate Fetcher from 2 sites: I've programmed the tool to bypass javascript protection on realestate.com.au. The tool is generating proxies on the fly to avoid any kind of block. Video: [login to view URL] Project URL: https://www.freelancer.com/projects/web-scraping/Web-scraping-21325442 ///// 927,291 Fetched Data from [login to view URL] within 10 mins and saved into CSV file / xlsx file Video: [login to view URL] ///// (Grocery Store) Fetcher With images: this program is fetching the site's products and save the data in an Excel .xlsx file. And also save each product's images into an image folder. Video: [login to view URL] Project URL: https://www.freelancer.com/projects/excel/NEED-ENTRIES-EXCEL ///// web scrapping for a HUGE site ([login to view URL]), Which is for (Car parts), Video: [login to view URL] ///// My Proxy generator, And also can bypass Cloudflare: [login to view URL] I hope to hear from you. Thank you.

$100 USD in 3 days

5.0

(22 reviews)

5.2

26 freelancers are bidding on average $168 USD for this job

@LiveExperts

Hi there,I'm biddin on your project "Break down HTML pages by Header and associated text" I have read your project description and i'm an expert in Python and machine learning therefore i can do this project for you perfectly.I still have a few questions. please leave a message on my chat so we can discuss the budget and deadline of the project. Thanks. .. .

$250 USD in 4 days

4.8

(103 reviews)

8.0

@schoudhary1553

Hello, I can help you with your project - Break down HTML pages by Header and associated text I have gone through your job posting and become very much interested to work with you. I am an expert in this field. I have already completed several projects like this. For evidence you can see my profile. Please visit : https://www.freelancer.com/u/schoudhary1553 I have excellent command over English. I am a hard worker, productive and worthy of your attention I hope, I would be the right candidate for this post. Awaiting an affirmative response from you. Kinds Regards, Sandeep

$220 USD in 4 days

4.9

(223 reviews)

7.7

@umg536

Hi there, I'm biddin on your project "Break down HTML pages by Header and associated text" Being an expert in Python and matlab programming I can do this project for you. please leave a message on my chat so we can discuss the budget and deadline of the project. Also, have a look at my profile for my reviews and portfolios. Thanks Note: This is not an automated bid and i'm ready to discuss your project right now. .. .

$250 USD in 4 days

5.0

(46 reviews)

7.3

@nicrosoft

Dear Prospective Employer, I hope you are doing well and thank you for sharing your project requirements, I'm willing to work on your project immediately. Please send me a message in chat so we can further discuss your project. You can also view my portfolio is at: www.freelancer.com/u/nicrosoft My Services ◆ Daily Communication and service delivery. ◆ Website maintenance for a month, following development. ◆ Will Communicate with you according to your time zone. Best Regards, Malik Farhan

$200 USD in 5 days

4.9

(94 reviews)

7.2

@writingapp

Hi. I am ready to write your project. I have written many automation projects. Will complete within 3 days

$190 USD in 3 days

5.0

(197 reviews)

7.0

@ZnDevelopers

Hi, I am ready to start it. But i have some questions for you. So kindly leave message for me, then ill discuss it in depth.

$150 USD in 3 days

4.8

(179 reviews)

7.0

@shantanupython

Very interesting concept, i like it ! would much enjoy developing it, for the web interface, do you have a server ? or want me to suggest a small linux server which will handle the web app and the scraper ?

$187 USD in 4 days

5.0

(88 reviews)

5.8

@BelisaG

Hey dear I am very interested in your project. I have understood fully your requirement As for me, I am a full-stack developer with 5+ years experiences Specially, I have good talent about web scrapping and html analysis Please contact me and let's start right now Thank you

$200 USD in 3 days

5.0

(5 reviews)

5.5

@umairkaramat24

Hi! How are you doing? I have read the project description and really interested in this job, I have 4 years’ experience doing similar jobs regarding to these skills Software Architecture, Javascript, HTML and Python. You can check my profile portfolio and reviews, also I have some questions regarding to your project. Please start the chat so we can have detailed discussion about job. Thanks!

$155 USD in 10 days

4.9

(28 reviews)

5.1

@privatecaptain

Hi, I can make this program for you by tomorrow. Shoot me msg & let's get started tonight. Thanks

$250 USD in 1 day

4.5

(25 reviews)

5.4

@saadtariq329

Hello there. I have seen your job posting. I will like to ask some questions. Please come over the chat so we can discuss things. Some intro about me. I am an enthusiastic developer/implementer who does not stop until or unless i fulfill all of your project's requirements. I don't call myself a GEEK as pride consumes the weak but i don't put up a break till the finish line. Let's talk over the chat and start this project right away. You've found your perfect fit for this work as you're are seeing the proposal of a right guy. I am waiting anxiously for you to come over the chat-- so we can fill in some missing pieces of puzzles in the requirements you've mentioned here. Please check my certifications to estimate my skills

$140 USD in 7 days

5.0

(8 reviews)

4.4

@umartechboy

Its completely doable. I've done similar automation things many times before for my own convenience. i can additionally deploy the application of an amazon EC2 machine where it can sit for one year without any charges at all. I'll need less than a day to complete the job after you get me started. The bid is negotiable.

$178 USD in 1 day

5.0

(1 review)

3.3

@christian010

Hello Sir, This project could be done in 48 hours, the budget you are setting is generous and since I am an honest person I am requesting only the real value for this project. I could start inmediatly and develope the system in Php or in C# MVC. I promise a high quality robust software to secure your investment. No upfront payment required, you only pay once the project is finished and bug free. Please send me a message if you have any questions. Kind Regards.

$100 USD in 2 days

5.0

(8 reviews)

3.1

@dark

Dear Sirs, I have extensive software development experience and would be happy to drive this project to successful completion. Best Regards, Igor D

$200 USD in 7 days

5.0

(1 review)

1.9

@alpaboghara901

Hi, My name is Alpa Patel, - 7 Years of Professional work experience in creative Website Design, Design Landing Page, Blog Install, logo design and Graphic Design as per current UI/UX market trends. - I have carefully read the requirements of the project, and all the requirements meet my skills and experience level and time will depend on work, let’s discuss more about your project in the chat box. - Development experience building WordPress driven websites, HTML5, CSS3, Bootstrap, JavaScript, jQuery, Responsive Layout, Issue Fixing. - Understanding PHP/.Net coding and web standards. - Good knowledge on WCAG, W3C, Website Optimization & GIGW compliance. - Good skills in logo design, icons, banner design, business card and letterhead to make attractive. You can see an example of one of those projects in my portfolio here: https://www.freelancer.in/u/alpaboghara901 Thanks.

$200 USD in 5 days

5.0

(3 reviews)

1.0

@kuetedonald

Experienced(6 Years), Android and Ios(Native or Hybrid), PHP, Delphi , Python, Vb, C# and Java developer and web designer with the depth knowledge related to MySQL,Codeigniter,Laravel,WordPress,MSSQL,JSON,JAVASCRIPT,AJAX,XML,jQuery,CSS with the integration of web technologies. Expert In Artificial Intelligence, Algorithm in Image processing and Embedded System using Arduino or Raspberry PI 3

$100 USD in 7 days

0.0

(0 reviews)

0.0

@pankajsamaspuria

Work with me is great deal for you I have done your job with my experience and give you a soft touch Relevant Skills and Experience I have done so much project like that and have 5 years experience of tha field

$78 USD in 3 days

0.0

(0 reviews)

0.0

@coolrock991

I will make python web based application wich will accept accept domain from text file. And then will provide with csv file with the format provided by you Relevant Skills and Experience My expertise are in python , HTML CSS, bootstrap , hosting

$156 USD in 3 days

0.0

(0 reviews)

0.0

@yassineelkasmy

Im Python Developer since 2015 , Advanced in Web Scraping and i have done similar projects before ... I can do this quickly for you.

$180 USD in 2 days

0.0

(0 reviews)

0.0

@Wesucceed

I am eager to impress and fast. Give me this chance to make a functional cool script. This can be done with a combo of javascript in frontend and python in the backend

$180 USD in 7 days