Find Jobs
Hire Freelancers

Big Data Architecture

$15-25 USD / hour

Closed
Posted over 4 years ago

$15-25 USD / hour

I want somebody to consult and develop me ETL pipeline & data warehouse (lake). I want the candidate The Deliverables 1. Delivery of the data definition for the ODS and the data warehouse that is responsive towards the KPI and reporting requirements of the client (provincial and central), including designed formulas to calculate values from the data for the required KPIs (e.g. throughput per program) 2. Accepted and feasible technical architecture for RDBMS, ODS and DWH 3. Definition of the format of the Operational Data store (ODS) that prescribes for every college the data set that they should keep/provide. (The BMS users will automatically comply with that, while non BMS using colleges should themselves prepare these data sets, or start using the BMS) 4. Delivery of the software programs (scripts) that allow uploading data from BMS using college databases on a frequent basis into the ODS (covering student unit data, lecturer unit data, employee information, resource usage (space), finance (assets, funding and budget)) 5. Delivery of the defined format of the data warehouse, data marts and selection of BI-tools 6. Technical delivery of the DWH and UI, including scripts for uploading from the ODS into data warehouse 7. Test and Acceptance of the Data warehouse 8. Define processes for maintaining the DWH (frequency of uploading data, data quality evaluation, reporting, DB maintenance) 9. Design a training- and usage plan. Reference for ETL [login to view URL] [login to view URL] Reference for Data Warehouse (Lake) [login to view URL]
Project ID: 21641620

About the project

8 proposals
Remote project
Active 4 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
8 freelancers are bidding on average $19 USD/hour for this job
User Avatar
I have gone through your job posting and become very much interested to work with you. I am an expert in this field. I have already completed several projects like this. For evidence you can see my profile. Please visit : https://www.freelancer.com/u/schoudhary1553 I have excellent command over English. I am a hard worker, productive and worthy of your attention I hope, I would be the right candidate for this post. Awaiting an affirmative response from you. Kinds Regards, Sandeep
$15 USD in 40 days
4.8 (3 reviews)
3.9
3.9
User Avatar
Hi, I'm ready to start working on your project , you can check my recent work on my portfolio, I'm waiting your reply.
$15 USD in 40 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Enterprise and IT Architect with over 3 years of experience in designing innovative business solutions for public sector clients. Skilled in cloud computing, information management, application development, and virtualization. Demonstrated mastery in evaluating requirements for business application integration and service activation. Proven mentor and training with expertise in communicating across organizational levels and with cross-functional teams to drive shared vision and foster culture of excellence. Skills - Kubernetes, Cloud Computing, AWS, Azure, Blockchain, Big Data, Spark, Databricks, .NET, C#, Python, SQL
$25 USD in 40 days
0.0 (0 reviews)
0.0
0.0
User Avatar
I've 3 years of experience in this so I'm well versed with it. Good knowledge and handson on ETL
$15 USD in 40 days
0.0 (0 reviews)
0.0
0.0
User Avatar
I'm an experienced freelancer database and report design, development and optimization with 10 years of experience . I have used Erwin tool for data modelling and i am well-versed with Normalization's for doing DB design. I am currently in Texas, US Here is few technologies I have mastered since last 10 years and can deliver the best solutions if you get me hired. 1) Sql Server 2005/2008/2012 2) MYSQL, MS Access 3) Oracle (PL/SQL) 4) SSIS, SSRS , SSAS and Power BI 5) Data analytics using R-Programming and SAS
$20 USD in 40 days
0.0 (0 reviews)
0.0
0.0
User Avatar
I will be working ETL tool talend for developing the kpi as per the business requirements Relevant Skills and Experience I am working on ETL TOOL FROM PAST 9 Months and during which i have worked on 3 different projects
$22 USD in 10 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hi, I am a professional ETL consultant. I have developed ETL pipelines using tools like Informatica, also used hive and spark on recent projects and maintained Data warehouses for clients like Volvo Cars (Sweden) , FCL (Canada) and all telcos in Pakistan. I have created data warehouses on Teradata Databases and also using Hadoop on commodity hardware and also on AWS instances which was a cloud-based solution. As a professional ETL consultant and big data engineer, I have the ability to design, architect and develop a data warehouse / big data solution for you using the open-source framework like Kafka for data ingestion if you want realtime ingestion or simple hive scripts if the data is not realtime and then we can use spark to transform data so that it can be used by 3rd party BI tools for presentation and analytics. Anticipating a quick response so that we can discuss this in detail. Thanks, Hassan Munir
$20 USD in 40 days
0.0 (0 reviews)
0.0
0.0

About the client

Flag of MYANMAR
Yangon, Myanmar
5.0
1
Payment method verified
Member since Aug 28, 2019

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.