· Experience in a similar Data Engineering role, who has attained a Graduate degree or above in Computer Science, Statistics, Informatics, Information Systems, or another
· Experience designing big data real-time processing solutions
· Building and implementing Big Data solutions using Microsoft Data Platform and Azure Data Services; including Data Factory, Azure Functions, Data Warehouse, Data Lake,
Data Lake Analytics, Data Bricks and U-SQL
· Working with both traditional and modern data architecture and processing concepts such as relational SQL and NoSQL databases
· Designing data pipelines to support machine-learning solutions.
· The right candidate must also be able to support and work with cross-functional teams in a dynamic environment in an AGILE development environment.
· Excellent knowledge and ‘hands on’ experience with Azure cloud computing including Azure
SQL DB/DW, HD Insight, Azure Data Lake Storage, Azure Data Lake Analytics, Azure Machine Learning, Stream Analytics, Azure Data Factory, Azure
Functions and Azure Data Bricks
· Create and/or maintain the data pipeline architecture.
· Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources.
· Design, coordinate and execute scalable data processing and analytics solutions, including technical feasibility for Big Data storage, processing, and consumption.
· Identify, design, and implement internal process improvements.
· Build analytics tools that utilize the data pipeline to provide actionable insights for data scientist team members.
· Ensure plan execution, document, and share technical best practices / insights with stakeholders to assist with
data-related technical issues and support their data infrastructure needs.
· Work with other members of the data team, including data architects, data administrators and data scientists
11 pekerja bebas membida secara purata ₹110000 untuk pekerjaan ini
Hi there, i have 3+ year of experience in azure data engineer having capabilities to work Individual and team work. Strong skill in python language. Let's talk about more in your inbox. Thank you