program/script Web crawling / web scraping find webshops

Cancelled Posted 6 years ago Paid on delivery
Cancelled Paid on delivery

We need a program/script in PHP and MySql that can take out data from web pages (Web crawling -also known as web scraping) and verify if it’s a webshop/ecommerce site.

The system must be on our server and work from there. All data and images must be save on the server.

You must provide us first how the dataflow will be make. It's important that the program is very easy to use for not technical person.

We upload an excel file with fx 10,000 domain names. Once the file is uploaded, we click on start and the system creates a new file with all needed data and images. If the website is a plain website without any shopping option we don’t save is.

If the domain have a webshop/ecommerce solution the program/webcrawler create a screenshot of the website and save all needed data and images.

We need to know:

All metadata (Meta descriptions first) :

Domain: [login to view URL]

Forwarddomain: [login to view URL]

url: [login to view URL]

faviicon (link and images):

Logon (link and images):

Mail adresser:

App link:

iPhone:

Android:

SoMe:::

Youtube link

Instagram profile

Google plus

Twitter

etc..

Webshops system:::

Magento

Woocommerce

Shopify

Etc.

We pay after the system is tested and approved by us on our server.

MySQL PHP Python Software Architecture Web Scraping

Project ID: #16710594

About the project

26 proposals Remote project Active 6 years ago

Awarded to:

DandySkull

Mumbu jumbo text för att fylla i 100 bokstääääääääääääääääääääääääääääääääääääääääääääääääääääääääääver xD

$300 USD in 7 days
(0 Reviews)
1.5

26 freelancers are bidding on average $486 for this job

mmadi

Dear Henrik2015 I have gone through your project program/script Web crawling / web scraping find webshops Can we do quick chat right now so that we can discuss the project briefly? I do have similar experience doi More

$525 USD in 12 days
(50 Reviews)
7.1
AhmedSalahA

i need more Description and i can do no problem with Python and the price can change after you speak with me

$250 USD in 10 days
(66 Reviews)
6.4
Accenza1

Greetings! We are a team of 100 developers each having an experience of more than 7 years. We design templates & themes, integrate paid plugins and develop customized plugins as per the functionality requirement in More

$555 USD in 10 days
(10 Reviews)
6.3
ranumehta2017

Hi There, HOPE YOU ARE DOING GREAT . After analysing your PROJECT DESCRIPTION & We are ready to start the project But here I have few questions which I like to discuss more your requirement Lets discuss more on ch More

$555 USD in 10 days
(48 Reviews)
5.8
techwobit

Hello, I always provide fastest results with quality scrapper . I have an experience of more than 10 years in web development and maintenance. I have in-depth knowledge of php, mysql, javascript , jquery, payment syste More

$250 USD in 10 days
(28 Reviews)
6.1
arjun366333

Ready to start the work to make the script in python or PHP as needed for scrapping the data from another website, we can discuss more over chat, thanks regards Arjun S.

$333 USD in 10 days
(30 Reviews)
5.6
anujayk

A proposal has not yet been provided

$333 USD in 10 days
(10 Reviews)
2.9
vandanavishwaka9

I have completed similar tasks, I'm open source enthusiast, will love to complete the task. i'll make it happens

$666 USD in 5 days
(5 Reviews)
1.8
PDCA

Dear potential customer, We can help you. We have a team of talented web scrapers that can help you collect the information you want. We can make sure the data is clean after scraping and we can help you insert More

$250 USD in 7 days
(2 Reviews)
1.2
androboy

I will provide you “User friendly UI/UX - Responsive Design - Design on latest trends - Eye catching effect Design Templates and Unlimited design revision - Robust and Bug free code with proper comments” In addition it More

$600 USD in 10 days
(1 Review)
2.2
bapixyrs

Dear Client, In my 5+ years as a full stack developer, I have successfully delivered numerous web solutions to my clients. I am confident I can do this project for you. Front End: HTML, CSS, Angular JS, React JS, More

$555 USD in 10 days
(3 Reviews)
0.4
WondersoftMS

Hello, Greetings from Wondersoft Multimedia Solutions! We got 6+ years of experience in Mobile & Web application development with deep knowledge in native/ hybrid application development. We have expert team of P More

$250 USD in 10 days
(0 Reviews)
0.0
Amiyatulu

A proposal has not yet been provided

$555 USD in 10 days
(0 Reviews)
0.0