Scrapy Spiders

by pkudriavcevas
Scrapy Spiders

Main task was to create spiders that would mine new data(prices,descriptions, sku etc..) from 47 ecommerce websites each week for price comparison website. Build spiders on prefered time interval crawling specified ecommerce sites and gathering all new product data. All data being cleaned and stored on database. On this project there was used complex technologies for scraping data from Ajax/Javascript based sites. Second part of project was daily spider that would detect if any product price changed. If found new price database would update. Created custom CMS for controling all spiders (run, schedule etc..). Viewing, editing,deleting mined data. Used: Scrapy, Django frameworks, Selenium WebDriver, Python 2.7 Developer by Povilas Kudriavcevas Data is Gold!

image of username pkudriavcevas Flag of Lithuania Neveronys, Lithuania

About Me

My clients appreciate my services not only because I deliver top quality work, but also because I always add more value to their initial idea. I'm passionate about what I do even if it's simple task I always put my heart, my mind and full energy to the projects I take. Let's team up!

$50 USD/hr

24 reviews
5.3

Tags