Find Jobs
Hire Freelancers

data munging, cleansing, builduing, predictive model, local regressors and clustering

£20-250 GBP

Closed
Posted about 1 year ago

£20-250 GBP

Paid on delivery
1 Part 1 - Building up a basic predictive model Load the dataset [login to view URL] into a pandas dataframe and carry out the following tasks. Organise your code bearing in mind robustness and maintainability: 1. Data cleaning and transformation: If you have a closer look at the dataset, you will see that there are lots of missing values. They need be treated appropriately but in the first instance, we will take an aggressive approach to dealing with them. • Show the shape of the dataset • Rename incorrectly formatted column names (e.g. SALE\nPRICE) • Create list of categorical variables and another for the numerical variables • For each numerical column, remove the ',' the '$' for the sale price, and then convert them to numeric. • Convert the 'SALE DATE' to datetime. • For each categorical variable, remove the spaces, and then replace the empty string '' by NaN. • Replace the zeros in Prices, Land squares, etc. by NaN • Show a summary of all missing values as well as the summary statistics • Drop the columns 'BOROUGH', 'EASE-MENT', 'APARTMENT NUMBER' • Drop duplicates if any • Drop rows with NaN values • Identify and remove outliers if any • Show the shape of the resulting dataframe. • Consider the log of the prices and normalise the data. 2. Data Exploration. Consider the resulting dataframe. This first aggressive cleaning should give a smaller dataset, which you can start by exploring relationships between the various features of the dataset. • Visualise the prices across neighborhood • Visualise the prices over time • Show the scatter matrix plot and the correlation matrix • Any further plots, which demonstrate your understanding of the data 3. Model building. Consider the resulting dataframe. • Select the predictors that would have impact in predicting house prices. • Build up a first linear model with appropriate predictors and evaluate it. Split the data into a training and test sets; build up the model; and then show a histogram of the residuals. Evaluate your model by using a cross-validation procedure. 2 Part 2 - Improved model This is an open-ended question and you are free to push your problem-solving skills in order to build up a useful model with higher performance. 1. Consider the entire datasets given in this assignment. Develop an improved predictive model that predicts the sales prices of houses. Make sure to validate your model. You should aim for a model with a higher performance while using a maximum of data points. This implies treating missing values differently for example through imputation rather than dropping them. 2. Use the K-Means algorithm to cluster your cleansed dataset and compare the obtained clusters with the distribution found in the data. Justify your clustering and visualise your clusters as appropriate. 3. Build up local regressors based on your clustering and discuss how this clusters-based regression compares to your regression model obtained in Part 2. 1.
Project ID: 36266248

About the project

25 proposals
Remote project
Active 11 mos ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
25 freelancers are bidding on average £121 GBP for this job
User Avatar
Top 1% in Freelancer.com Hi, Greetings! ✅checked your project details: ✅Completed Time: In project deadline We have worked on 850 + Projects. I have 6 + years of the experience in same kind of projects. I am available almost 24-7 and am very responsive. My Portfolio Items: https://www.freelancer.com/u/schoudhary1553 Kindly contact me via chat for further details and discussion. Thank you Sandeep
£180 GBP in 3 days
5.0 (339 reviews)
8.1
8.1
User Avatar
Hi there! I have more than 10 years of experience as a Data Base Administrator and Analytics Engineer. I'd love to work together on your project building your excel models. I'm so responsible and kind, I'll always send you the files on time and with the best quality. Send me a message and I'll start working on your project. Best Regards, Giovanni.
£20 GBP in 1 day
4.9 (23 reviews)
6.1
6.1
User Avatar
Hello i am engineer in Statistics, have a good experience , i can help asap................. regards
£200 GBP in 7 days
4.9 (15 reviews)
4.4
4.4
User Avatar
Hey I am expert in python and I can help you with your project message me to discuss so that we can start working on it
£50 GBP in 1 day
4.9 (6 reviews)
3.8
3.8
User Avatar
Hi, Dear Employer. I am Al.A. I am a Ph.D. backgrounder and professional Excel and data scraper with over 12+ years of experience. I will provide you high-quality Excel file. I have worked on similar projects of Spreadsheets /Excel /Web Scraping /Data Mining/Excel Macros/ Excel VBA/ Capabilities,/ CSV,/ and I can deliver professional excel to tight deadlines. Please feel free to send me a message for a chat to discuss your requirements." Gratefulness " Al. A
£135 GBP in 3 days
4.4 (3 reviews)
3.4
3.4
User Avatar
Hi. How about you? I have just read your proposal and I am sure I can complete the project on time. I am an expert in ML/DL who has 10+ years of experiences. Please contact me to discuss about the project in more details. Thanks. Best Regards. From Bac.
£50 GBP in 2 days
5.0 (2 reviews)
3.1
3.1
User Avatar
Hi, Iam data analyst and have relaive experience to deal with your project. I can provide a Jupyter notebook book with part one requirements in one day and can complete the project with max 3 days. Please get in touch to discuss further details Thanks
£150 GBP in 7 days
5.0 (8 reviews)
3.3
3.3
User Avatar
Hi there, I have read your project details.I can build you a predtive model for your manhattan data set . I will all the data science techniques such as data preprocessing visualizations to build model for you. Message me so I can assist you with this. Thanks
£85 GBP in 4 days
5.0 (3 reviews)
2.2
2.2
User Avatar
I will do able to do this project because I expert in ms office and its its related all work so I want to give me this project.Thanks.
£20 GBP in 4 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hi, I can help u as i have done several similar jobs related to Data Processing, Big Data, Data Cleansing, Pandas and Predictive Analytics, I have read the details and furthermore discuss about it, plz discuss with me in detail. Regards
£250 GBP in 9 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hi, dear client, I have seen your description, I am an associate degree professional in Data Processing Analysis, data extraction. I am also an expert in python data scraper . Please send a Maine sage to contact me to debate additional relating to this project you'll be able to read my past accomplished work by sound the beneath interface; I'm interested to hear more about the project. If you award me the project I'd be very happy to discuss this further and get started for you as soon as possible. Thanks!@riyadhasnat06
£135 GBP in 7 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hi, I am new on the site but this is my function basically in my job which is required on your project. I am dealing in large data sets and I have finished nearly 70 projects in last two years. Presently, I am working for Pharmaceutical MNC. Following my passion, I am keen to work on different projects and will make me happy contributing in success of others. Thank you for your time.
£70 GBP in 4 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hi! I am Junior Actuarial Data Scientist. I can help you for this project.I have done many data analysis similar to this project before. I believe that I will analyze this project very well.
£45 GBP in 5 days
0.0 (0 reviews)
0.0
0.0
User Avatar
I am thrilled to have the opportunity to offer my expertise in data science to help you achieve your goals. As a skilled data scientist with a passion for solving complex problems, I am confident that I can provide you with valuable insights that will help you make informed decisions. My experience in the field has equipped me with a wide range of skills, including data analysis, statistical modeling, and machine learning. (Whether you need help with data cleaning and preprocessing, exploratory data analysis, predictive modeling, or any other aspect of data science, I am ready to dive in and deliver results.) I am committed to providing high-quality work and meeting your needs within the given timeframe. Moreover, I understand the importance of communication and will keep you informed of my progress throughout the project. I am confident that my skills and experience make me an ideal fit for your data science needs. Thank you for your consideration, and I look forward to the opportunity to work with you. Best regards, Talha Arshad
£100 GBP in 3 days
0.0 (0 reviews)
0.0
0.0
User Avatar
EXPERIENCED in dealing with data and cleaning part. Actively part of many ML competition to build and tune models. Can train your model in best outcome way. Recently worked on project name uber lyft price prediction of 6L records and perfectly modellled it.
£60 GBP in 7 days
0.0 (0 reviews)
0.0
0.0
User Avatar
☑️FULL-TIME FREELANCER☑️ I am an expert in any Scraping, Leads, eCommerce Product Uploading, all kind of Data Entry, PDF Form Creation, Web Search Expert who knows the value of time, is very hard-working, and always delivers the work on time. "Client's satisfaction is my Career" Areas of Expertise:
£135 GBP in 7 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hello, I’m a machine learning engineer and a certified data analyst. I’m a PhD student at the faculty of engineering and I have published papers in the fields of machine learning and computer vision. I have 9+ years of experience in programming with Python. I’m experienced in Python’s data science libraries such as numpy, pandas, and scikit-learn. Pls check my profile for my qualifications and portfolio for examples of my previous work. I’ve read the project specs and requirements carefully, and I understand it very well. I’m able to perform all the mentioned cleaning, EDA, and modeling tasks. Pls chat to discuss all the details. I look forward to working with you. Best regards, Mohamed
£100 GBP in 4 days
0.0 (0 reviews)
0.0
0.0

About the client

Flag of UNITED KINGDOM
Tilbury, United Kingdom
0.0
0
Member since Mar 25, 2023

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.