Text Trend Analysis Solution

Cancelled Posted 5 years ago Paid on delivery
Cancelled Paid on delivery

Currently we have a web crawl solution that pulls raw data from websites. This solution is written in Visual Basic.

We require an improve trend-analysis of our raw data set (example attached) - which currently assesses the most popular "News Subject" based on the 'crawltext' column, via identifying the most frequently used words within the UK.

We are looking for an improvement that, by focussing on 'crawltext' column - can identify popular topics, which we can then use to identify an article that reflects that popular topic. We are looking for a solution that ranks a dynamic number (initially 5x) popular topics based on the data, and then allows us to pull an article for each popular topic.

The solution would have access to a MySQL database which contains the raw data (currently exampled in the attached Excel file) and would need to be set up for this in future.

We are open for this to be done in a different programming language, e.g. Python, so long as we include handshake signals between the VB programme and the solution, so that the solution runs AFTER the web crawl activity has occured on the VB, so that the solution interacts with the freshest data each time. Currently the web-crawl runs every hour in a day.

Please Note: This is for a concept service being built, and for that reason we are looking to manage costs and additional work over time. So we do not want an expensive solution that does everthing - rather, a solution that does the job (with minor issues) which we can commission to be resolved at a later time.

Data Mining Machine Learning (ML)

Project ID: #17645315

About the project

5 proposals Remote project Active 5 years ago

5 freelancers are bidding on average £605 for this job

shivampanchal

I have a good hands on working with Advanced R and Python and BI tools and technologies, AI, Big Data. I have quite a good knowledge of DL/ML Algorithm , have also developed Dashboards and Web Applications using flask/ More

£555 GBP in 10 days
(70 Reviews)
6.8
mingxiao2008

Hello, Dear How are you? I am very interested in your project and am ready for starting your project for now. I have experienced in developing Data Mining, Machine Learning I will work very hard and best for you. More

£555 GBP in 10 days
(5 Reviews)
4.9
d3bd33p

I've worked in similar projects before, for extracting trends and sentiments from crawled news data. Thus I went through your attached excel sheet and would like to know your requirement in further detail. Best, De More

£555 GBP in 9 days
(4 Reviews)
3.8
tbtsoftwares

Greetings!! I understood the current application pulls raw data from news websites and finds the most popular news subject. We need to improve the quality of tend analysis. This can be done by Page Rank, NLP or Know More

£361 GBP in 10 days
(4 Reviews)
3.4