Data Engineer
₹75000-150000 INR
Paid on delivery
· Experience in a similar Data Engineering role, who has attained a Graduate degree or above in Computer Science, Statistics, Informatics, Information Systems, or another
quantitative field.
· Experience designing big data real-time processing solutions
· Building and implementing Big Data solutions using Microsoft Data Platform and Azure Data Services; including Data Factory, Azure Functions, Data Warehouse, Data Lake,
Data Lake Analytics, Data Bricks and U-SQL
· Working with both traditional and modern data architecture and processing concepts such as relational SQL and NoSQL databases
· Designing data pipelines to support machine-learning solutions.
· The right candidate must also be able to support and work with cross-functional teams in a dynamic environment in an AGILE development environment.
Technical Requirements:
· Excellent knowledge and ‘hands on’ experience with Azure cloud computing including Azure
SQL DB/DW, HD Insight, Azure Data Lake Storage, Azure Data Lake Analytics, Azure Machine Learning, Stream Analytics, Azure Data Factory, Azure
Functions and Azure Data Bricks
· Create and/or maintain the data pipeline architecture.
· Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources.
· Design, coordinate and execute scalable data processing and analytics solutions, including technical feasibility for Big Data storage, processing, and consumption.
· Identify, design, and implement internal process improvements.
· Build analytics tools that utilize the data pipeline to provide actionable insights for data scientist team members.
· Ensure plan execution, document, and share technical best practices / insights with stakeholders to assist with
data-related technical issues and support their data infrastructure needs.
· Work with other members of the data team, including data architects, data administrators and data scientists
Project ID: #34319501
About the project
11 freelancers are bidding on average ₹110000 for this job
I have total 12 plus years of experience especially in Development, DWH, ETL, SSIS, SQA, Database development & maintenance. • Very strong in Open Interfaces, SQL, PL/SQL, Stored procedures/packages, writing Test Scrip More
Innovative and technically-astute software developer with 15+ years of experience in developing full stack applications. I am confident enough to do justice to your task and complete the task timely and fulfill the exp More
Hello Dear Client, after thoroughly reading your PROJECT DESCRIPTION i have clearly understood it and i would like to work with you. I am a skilled and experienced in the named SKILLS. I consider your project DOABLE as More
Hi, Greetings and hoping you are doing well, i welcome you to my profile where quality and client satisfaction is the Priority. I am Expert Dominic and i hope to cooperate with you on your project . CERTIFIED EXPERT I More
Hello Sir, We have over 20+ Years in Website, Software and Mobile App Development. We also providing Web Hosting, VPS and Domain Services. We Completed over 2500+ Projects. - 100% Client Satisfaction Rate - 20+ Count More
Hi Ian currently working as Azure Data engineer in my role and I have total do 7 years of experience and from tha 5+ years into BigData technologies.
Hi there, i have 3+ year of experience in azure data engineer having capabilities to work Individual and team work. Strong skill in python language. Let's talk about more in your inbox. Thank you
I am Best known for my ability to rapidly deliver solutions that deliver significant business value. Over the course of my career, I have been instrumental in delivering numerous cost and process improvement actions us More