Need python script that scrapes articles from industry publications

I'd like to scrape MotorTrend articles on vehicles over the last five years. Additional requirements are here: [login to view URL]

Expected deliverables:

1) A tested and proven python 3 code base, preferably using the Scrapy library, which crawls the website and pulls car industry publication reviews ([login to view URL]). Need car reviews for last 5 years worth of cars.

2) Codebase includes testing, full commenting, and descriptive error messages

3) Scraping is “polite,” meaning it scrapes as a human would browse.

4) Proxies are optional and are able to be used if necessary

5) Project scrapes the key facts, like horsepower, torque, curb weight, and dimensions listed at the bottom of reviews.

6) The output of this scraping would be to a local MySQL database. Fields to populate database are make of car, model of car, year of car, all key facts under respective columns, hyperlink to review, title, and car review wording. Only need the heading, and p tags for the car review. Please include tags as one body of text and exclude actual tags. Dimensions for scraping are in the original document.

Skills: Python, Web Scraping, MySQL, Software Architecture, PHP

See more: php script sell articles online, python script installieren, need classified script, python script output text file, python script scrapes results google search, python script scrapes, need help write python script operate telit module, need write python script telit gc864quad module, project need python script, i need a script writer, i need python programmer, do i need python 2 2 1 on my computer, i need python shell, i need python script, I need help with a python script, I need a script written that i can run on a windows PC to rename 30,000 images from its existing name to another. -- 2, I need a script written that i can run on a wind, I need a script written that i can run on, Need a java, php or python script writer (Expert only) — 3

About the Employer:
( 1 review ) Santa Clara, United States

Project ID: #22129849

22 freelancers are bidding on average $467 for this job


Hi, my name is Selim. I am from Solihull, UK. I read your `Need python script that scrapes articles from industry publications` project descriptions carefully before bidding. I checked the attached google doc, and your More

$600 USD in 7 days
(304 Reviews)

Hi there,I am Web Scraping expert from Bosnia & Herzegovina,Europe. I have carefully gone through with your requirements and I would like to help you with this project ! I can start immediately and finish it within the More

$500 USD in 7 days
(169 Reviews)

Hello Sir, I am expert who understands the value of time. I pride myself in my attention to detail. I am very hard working and aim to deliver in less time than quoted. I want to make you, my employer happy without cha More

$500 USD in 10 days
(150 Reviews)

Hi. I’m senior full-stack developer and expert in Python. I can do your project successfully. My talent and trustworthy will make your project meet success. I hope to contact soon. Thank you. Alex T

$500 USD in 7 days
(12 Reviews)

I have done many similar projects related to web scraping information from different websites. Very interested to work on this project. I am absolutely confident I can finish this work on time and on budget to highest More

$500 USD in 10 days
(212 Reviews)

Hi there, The requirements are very clear. I would approach your project by using Python/Scrapy. I have done many similar projects​. Let check some demos here: - Price tracking system: [login to view URL] More

$650 USD in 7 days
(127 Reviews)

Hi I have more than 7 years of experience in web scraping domain. I have written more than 300+ crawlers in different domains. I have gone through your requirements and clear regarding instructions except couple of More

$500 USD in 10 days
(127 Reviews)

Dear sir! ⭐I am very interested in your project and I am exciting. ⭐I read your project details carefully and I though that I am the best fit developer for your project. ⭐I have rich experience about your proj More

$600 USD in 10 days
(52 Reviews)

hey, I have checked the detailed requirements as well as the website. ([login to view URL]) I can make you a PYTHON3 script to get the data to MYSQL database as per the schema in your More

$250 USD in 2 days
(191 Reviews)

Hi I'm a python coder with 12+ years experience. Yes, I can scrape with Scrapy, then clean the data before writing to your Mysql DB. I can also make the system multi processing so it pulls several pages at once , thu More

$750 USD in 7 days
(13 Reviews)

How do you do client. My name is Valentine Web scraping expert who knows the value of time, working hard and always working on time. I already completed some project similar yours such as Bet 365,facebook tool. To con More

$500 USD in 7 days
(38 Reviews)

Dear Sir/Madam, I specialize in web scraping. Ready to start ***************************************************************

$250 USD in 7 days
(33 Reviews)

hi i saw you your post regarding web scraping.i have done many similar tasks like this i can make a scraper for you maybe i can add a feature like scraping particular data from website and save into excel or csv or in More

$400 USD in 7 days
(21 Reviews)

Hy, I can effectively do web scrapping of car data with python using a variety of tools like scrapy, beautiful soup, selenium, and many others. I am an experienced Python programmer with 4 years of experience. Currentl More

$500 USD in 7 days
(13 Reviews)

I I'm a professional data scientist from Scotland I have got more than enough experience with AI and ml models I am more than happy to discuss your project please drop me a text here and I should reply back.

$833 USD in 1 day
(7 Reviews)

Hi there, first of all thanks for commenting so well the requirements since most of the time all the information about site and data is missing. I've been analyzing motortrend and I already found access to all the firs More

$250 USD in 6 days
(7 Reviews)

Hello, How are you? I'm very interested in your job post.I believe my skills would be ideal for your project. I am Python Expert and I can help you perfectly. And then I am a good english speaker. So anytime,anywhere y More

$500 USD in 7 days
(8 Reviews)

Hi Adrian. We have discussed this project before ======================================================

$250 USD in 5 days
(4 Reviews)

Hello, I have just read your requirement carefully and I am very interesting with your project. Webscraping is my top skill. No problem for everything!!! I can complete your project using spider or selenium etc in pyth More

$400 USD in 2 days
(4 Reviews)

Dear client, nice to meet you. It's Esther - the senior scraping developer from Seattle, WA, United States. As you see, I am new on this platform so I have only one review but my knowledge and experience are enough to More

$500 USD in 7 days
(4 Reviews)