Change/Keyword monitoring system/website
$250-750 USD
Paid on delivery
The idea here is to build a simple monitoring service for users to track websites for the appearance of certain keywords.
I have a small bare-bones prototype running as a bash script (curl gets the source code, this is stored in a variable. Grep then checks the variable contents for a specific keyword. If the keyword is found an email is sent). A cronjob then runs this all every minute. This needs to be scaled up so that it can be used by multiple users on multiple sites for differing keywords (each user should be able to track a set of websites for keywords/changes).
The final system should allow users to log in/sign up. Sign up would require a creditcard and optional phone number (to send the notifications to - users have the option between email and sms notifications). Creditcard payments are to be processed through Stripe. SMS are sent through Twilio.
Then there'd be the generic settings panel that allows users to set what sites they want to track, what keyword they want to look out for, and the interval at which they want to track (x seconds if possible/ x minutes / x hours / daily / etc. )
Before starting this project I'd like to discuss the minimum possible interval for such a service and the server requirements (eg. what if 1000 people want to track 10 websites at 10 second intervals?).
Project ID: #6303202
About the project
Awarded to:
We are expert on website crawl & scrap and link & keyword monitor technologies and having vast experiences on the same. I would like to suggest few more point for parsing the page to fetch the keywords and related info More
12 freelancers are bidding on average $651 for this job
Hello, as it was mentioned in the message log above, there is number of Queue systems that allows for such an approach, nsq, zmq and RabbitMQ all designed for queueing tasks the question is you mentioned 3 programming More
While I am not working as programmer on my daily basis I could help you with appropriate OS system setup if you are targeting for something more scalable. Also I could provide professional consults regarding used techn More
hi, i can develop the front end for you for user registration, login, monitoring attribute setup, payment+email/sms notification using PHP/Perl CGI for backend we can scale the load thru amazon clouds queuing and ec More
Looks OK for me, and also interested in your project, Thanks! ########################################################################################################################################################### More
hello, i am red hat certified engineer and i easily can do this task i am expert in python and more then 5 year experience in this field ready to start now thanks
