I need you to develop some software for me. I would like this software to be developed for Windows using [login to view URL] scrapping - Need to do a webscrapping of a site and store them on to our firebase DB using Python.
Our firebase DB has all the fields to be stored.
Scrappy is an efficient library available for python to do the web scrapping.
Need to host them on a heroku server and set a cron so that it runs daily at scheduled time.
Hi.
Please let me know the site you want to crawl and also what is the data you want to be saved in DB. Of course scrapy is the best framework to make this done.
Let me know when we can start.
Hi there, I have read the project description & would like to disucss.. I have done many web scraping & data mining projects.. Let me know & we can discuss details.. Thanks..
Hello
I'm a software developer with 10+ year of experience and 5* rating. I developed several complex scrapers using all the techniques. If you insist it can be Scrapy. But it has no JavaScript support and only works for the simplest tasks. But the simplest tasks can be done without any framework - directly by http requests.
Please tell me more about your requirement.
Best regards,
Denis Poduzov
I am a computer programmer with a background in retail and specialize in scraping online stores. I am confident I get this done quickly and efficiently. Contact me with the site details and the required field and I will confirm the time and cost estimate. Thank you for your time!
I am a graduate student at Purdue with specialization into Machine Learning, Pattern Recognition and enjoy programming. This project would serve as a good learning curve for me as well.
I would appreciate it if we could talk more about the requirements for this project.
Thanks!