Scrapping of 6 paintings websites with python

Completed Posted 6 months ago Paid on delivery
Completed Paid on delivery

We are seeking the development of six simple Python scripts, designed for data collection from various art websites. These scripts will be tasked with aggregating extensive information on paintings from multiple renowned online art repositories, with the ultimate goal of storing this data into an SQLite database.

The scripts must be equipped to handle and gracefully skip over any HTML parsing errors or encounters with 404 pages, logging such problems.

Data to Collect: For each painting, the following information must be meticulously gathered and stored:

Title

Artist

Description

Imageurl (of the largest size)

Date

Style

Genre

Media/Medium

Location/Current location/Museum

Size/Dimensions

Data Extraction and Parsing:

Each script should proficiently extract detailed information on paintings from the following sources:

[login to view URL]:Paintings_by_artist

[login to view URL]

[login to view URL]

[login to view URL]

(on the artwork follow the link "More details" or "Entry" to get all informations)

[login to view URL]

[login to view URL]

(After partner, follow "View All")

Objective:

Our aim is to create a centralized, easily accessible database of painting information, aiding in research and appreciation of these artworks. This project is an excellent opportunity for Python developers with an interest in art and data management to contribute to a valuable cultural resource.

Project Deliverables:

Six Python scripts, each corresponding to a specific data source.

A comprehensive SQLite database schema for storing the collected data.

Documentation outlining the usage and features of each script, including error-handling mechanisms.

Ideal Candidate:

Proficient in Python, with experience in web scraping and data parsing.

Familiarity with SQLite and database management.

Strong problem-solving skills, particularly in the context of web data extraction.

An eye for detail and a commitment to accuracy in data collection.

Python Web Scraping

Project ID: #37443672

About the project

134 proposals Remote project Active 6 mos ago

Awarded to:

rolesh

Hello, I can finish this project in 6 days. With a solid background in these areas, coupled with experience in SQLite and database management, I am confident in my ability to contribute effectively to your team. I hav More

$300 USD in 7 days
(1 Review)
3.0

134 freelancers are bidding on average $426 for this job

livegoodlife

Hello there, I am experienced in web scraping and to build script or a windows desktop application by using python. I am also experienced in large data scraping from the given website, by pass IP, Captcha, and anti bo More

$400 USD in 7 days
(268 Reviews)
7.9
chirgeo

Hello there! My name is George and I’m an experienced web crawler specialist. I've read through the task thoroughly and I believe I'm the ideal candidate, meeting all your criteria. My commitment to accuracy and atten More

$750 USD in 3 days
(155 Reviews)
8.1
uumarkhalid31

Hello! I specialize in Python script development for data aggregation. I'll create six custom scripts to efficiently gather extensive painting details from diverse art websites. These scripts will seamlessly compile da More

$350 USD in 3 days
(268 Reviews)
7.3
AwaisChaudhry

Hey Good evening , Just finished reading the brief details . I see you have been looking for someone who has experience with these tech stacks Python and Web Scraping. I will request you to review my profile, skills, p More

$750 USD in 10 days
(14 Reviews)
7.0
AITSoft

Hello,I have read the job description and I am interested in this job. I have 8 years experience in developing products using Web Scraping and Python. I have read your requirements and am ready to start working for you More

$750 USD in 16 days
(39 Reviews)
6.3
rahulg5466

Hi there. ⭐⭐ I am a full stack Developer ⭐⭐ with experience in HTML, Javascript, Blockchain, AWS, MY SQL, Bot Developement, Web, Machine Learning (ML), PYTHON, Deep Learning and Communications. I have worked with many More

$350 USD in 7 days
(64 Reviews)
5.8
ThilinaG01

Hello, I'm a Python programmer with three years of experience in web development, data analysis, and automation using Django, Flask, Pandas, and more. I'm also proficient in HTML, CSS, JavaScript, and SQL. I can deliv More

$500 USD in 10 days
(40 Reviews)
5.5
rashidamjad

Hi there, I'm excited to express my interest in your Scrapping of 6 paintings websites with python project. With 4-5 years of experience in Python and Web Scraping, I'm well-prepared to add significant value to your i More

$700 USD in 15 days
(11 Reviews)
5.2
Isoropisths

Hello, Client. Thanks for your job. This is Ioannis from Greece. I understand your explaination and can start this project immediately. You can see the knowledge, skills, and rigorous work style of the Greek people. Be More

$300 USD in 3 days
(5 Reviews)
5.4
GdevDataSceince

Hi there ,I am a Data Scientist is a professional responsible for extracting actionable insights and knowledge from large volumes of data. I have over 12-plus years of experience with python library Pandas, Karas, Tens More

$270 USD in 2 days
(14 Reviews)
5.2
avinashdubeyg209

Hi there, I am an ML engineer. I can start right away and deliver within the deadline. So, Let’s have a quick conversation. I can be more specific once we get all the requirements and information required to execute th More

$300 USD in 7 days
(46 Reviews)
5.4
Rekhathakur

Hello there! My name is Rekha and I am a senior Web Developer with 8+ years of experience in web development. I specialize in Drupal, Joomla, Magento, PrestaShop, WordPress, Shopify and other similar frameworks. We More

$750 USD in 12 days
(3 Reviews)
4.8
NadMax

Hi. Experienced Python developer here with 8+ years of hands-on experience, I can assist you in developing six Python scripts for seamless data collection from various art websites. To proceed further, I kindly reques More

$500 USD in 15 days
(3 Reviews)
4.9
muneebkhalid006

I am a full-stack Java developer with extensive experience in Python and SQL, skilled in web scraping and data management. My technical expertise aligns perfectly with the requirements of your project to develop a cent More

$250 USD in 1 day
(3 Reviews)
4.8
arbu1499

Hello! I'm eager to take on the development of these Python scripts for your art data collection project. With my expertise in web scraping, data parsing, and SQLite, I'll ensure accurate extraction and storage of pa More

$340 USD in 5 days
(9 Reviews)
4.5
chwaqas5434

Hello there! My name is Waqas and I am a Python developer with extensive experience in web scraping and data parsing. I am confident that my skillset will be the best fit for your project requirements. We understand t More

$250 USD in 7 days
(22 Reviews)
4.6
SourceOasisBPO

Hello! I took a delightful dive into your project description, and boy oh boy, it seems like my skills are a perfect match for this gig! I am an expert which have many years of experience on Python, Web Scraping Qui More

$470 USD in 6 days
(10 Reviews)
4.7
rajeevnewnetlink

Hello Laurent B., We would like to grab this opportunity and will work till you get 100% satisfied with our work. We are an expert team which have many years of experience on Python, Web Scraping Please come over ch More

$480 USD in 7 days
(7 Reviews)
4.2
mirzatauseef

Hi there! My name is Tauseef and I am a software engineer and effective leader with eight years of experience in a variety of development and engineering positions. I have extensive experience in Python, web scraping, More

$399 USD in 20 days
(9 Reviews)
4.3
valeriivapirov

Hello I am a seasoned Scraping Expert with expertise in Python and JavaScript. I have extensive experience using BeautifulSoup, Puppeteer, and Scrapy for advanced web scraping and generating actionable insights. Here More

$500 USD in 7 days
(4 Reviews)
4.0