Find Jobs
Hire Freelancers

Quick Task modify a python script

$10-30 USD

Cancelled
Posted over 4 years ago

$10-30 USD

Paid on delivery
Hello i have a small code approx 10 lines of python code we are using it to read text files and insert data into mysql tables there is total 115 text files and data is more then 80GB we are facing some issue 1- We are unable to know how much data remaning and which file is done and which is remaning 2- script entring duplicate data too 3- We need to ad data to mysql faster as much is possible we have big servers for that Task for now validate data to pervent duplication . also fast speed it can use Ram and computer cpu also show us progress
Project ID: 23582174

About the project

8 proposals
Remote project
Active 4 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
Awarded to:
User Avatar
Hello I have read your project carefully and we have made multiple projects like that before in our agency I can you a sample of our work please chat with me to make sure we are very experts at our work hope to hear from you very soon and we can have work together thanks
$30 USD in 7 days
5.0 (1 review)
0.8
0.8
8 freelancers are bidding on average $48 USD for this job
User Avatar
Hello, I can try to optimize your python script to work a more efficient way. For the part 1, I can first count the text files and count backwards to print how many remained each time. and I can print or save name of the file that is inserted into sql database. For the removing duplicate file, I can make an array or list which contains the data that has been uploaded to server and when it sees the duplicated file, do not upload. These are basic python functionality. I can also think about what can be done for the speed of data transfer to server. I can complete this project within a day and for 30 dolars but for the speed of transfer makes some time to find a proper solution therefore I put 59 dollars. We can negotiate if you can write to me
$59 USD in 5 days
5.0 (8 reviews)
3.2
3.2
User Avatar
Hey, My name is Andrzej Gurjew. I am an experienced Python developer. I will be glad to assist you with this task. Please pm to discuss the details of the cooperation.
$25 USD in 1 day
5.0 (1 review)
1.9
1.9
User Avatar
Hello!! We are DSPro, a software development agency specialized in providing services and products to companies, through cutting edge technologies such as Cognitive Computing, Backend systems, Data Pipelines, Machine learning, Internet of Things (IoT) and Artificial Intelligence. We are specialized in the development of software applications with huge data pipelines systems, and also, we have knowledge in Backend development, Python, Jupyter Notebook, Javascript, PHP, HTML, MySQL, Data Mining, Data Processing, APIs, Software development, software architecture and design and other technologies. The main mission in DSPro is to do the best job on your projects, to the smallest details, to provide you with an excellent and complete job. We want to give you an excellent job experience, in exchange of your satisfaction face with the results and your review to us. Your challenge is exactly what we are searching in order to our experience with Engineering. We have nicely done hundreds of projects like yours, with a lot of happy clients. Please give it a moment to talk with us and show you our experience. Thanks you for your time Will be a pleasure talk more about your project with you!!! Best Wishes Anthony Muñoz, DSPro
$49 USD in 7 days
5.0 (2 reviews)
1.7
1.7
User Avatar
Hi, Although your data size is not small, we can create a python program that can process many files at once and insert multiple records at once in the database which may result in significant speedup. At the same time we can monitor the progress as a percent for each of the files processed
$111 USD in 5 days
5.0 (1 review)
0.8
0.8
User Avatar
We have read the requirements of this project and we can help you with it. We have deep experience with python and can deliver the optimization of the code required in a few days.
$30 USD in 5 days
0.0 (0 reviews)
0.0
0.0
User Avatar
I am unemployed,
$25 USD in 1 day
0.0 (0 reviews)
0.0
0.0
User Avatar
Welcome. I can take care of it. 1 needs more information. for example: Sample input data and data structure in the database. there can be many problems. Database problem. Problem with input. (the input data structure may have an error) Script problem.
$55 USD in 7 days
0.0 (0 reviews)
0.0
0.0

About the client

Flag of PAKISTAN
Lahore, Pakistan
5.0
13
Payment method verified
Member since Jan 16, 2015

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.