I use a personal website to scrape VIP names in a french newspaper, and memorize them in a quiz-typed page.
The database on this website has just gone over the authorized 400 Mb, and INSERT and UPDATE commands are now blocked. [login to view URL]
1) DATABASE CLEANING
The database will have to be cleaned so it's back to 300 Mb at the most.
2) DATABASE GROWTH MANAGEMENT
I also ask for the long-term resolution of this overload problem, either by the addition of an automatic cleaning process, or by the removal of secondary fields and data.
3) MORE FREQUENT INSERTION OF DATA
Once this done, the automatic scrapping process, which is currently set to once per day, will be switched to once per couple of hours.
Hello,
This does not seem like the app we originally built but related. Is it an improved version of the original wiki scrapping application we did for research?
We would need just the DB dump to clean it up but for improvements, we would need access to the server/files.
Regards,
Rohit J
Hello,
I have worked with PHP/MySQL a lot and I am happy to help you. Let's get this resolved. I can work right now and am very motivated in completing this project today since it's payday on Freelancer.
Thanks!
Sergei
Hi, I have gone through your requirements.I have understood your requirement and I can do this job confidently.I think in this project nothing is there to describe technically. For your reference you can see out feedback and portfolio.
Please let me know if you have any concern.I am ready to start work now.
Thanks
Hello Mr alarconvw,
I've been programming (stand-alone and web) for almost 10 years now, even though I am new in freelancer.com.
I am at your disposal for any clarifications.
Thank you in advance for your time.
Michail Papageorgiou
Hi,
Dear Mr Ramon!
I have read and understand the description of this job and very interested to work on this project.
I know things were not so smooth in past, but it could be a great opportunity to start over.
Also I know much about the webscraper database, and can easily handle this stuff without affecting other data...
Let me know if you are interested.
Thanks
Sohaib
1. The database will be cleaned by removing data from the tables with the most data and storing them off in a flat file so they can archived and used later if needed.
2. There are 2 options for growth management being
- update your hosting functionality to grant you a larger amount of space for your DB
- create an auto-archive system that stores the data into flat files
3. This will require obviously more research depending on which route is gone between the 2 options in #2