Job Description
Your Responsibilities
- Combine Data Engineering skills—along with sound business sense—to facilitate data-driven decision making across the organization.
- Act as the subject matter expert within data engineering, with a primary focus on delivering digital services and products.
- Design and develop data pipelines on batch and streaming data using Azure Paas services.
You
- possess core competencies as a modern cloud data engineer/architect
- have a strong analytics background and knowledge of Azure stack – Databricks, Datalake , Event Hub , SQL Server etc.
- Have Python/ Pyspark Development as one of your core competencies.
- are hands on and like to do so for most of the time on a daily basis
- are solution oriented, efficient, and structured
- are curious and willing to challenge the status quo
- are motivated by innovation and knowledge-sharing
- drive results and lead complex projects with multiple stakeholders in a multi-cultural environment
- have a strong sense of issue ownership and business accountability
Qualifications
- You hold a relevant academic degree such as M.Sc. or M Tech/BTech. in Computer Science , Data Engineering or similar
- Knowledge and experience with Data Warehousing on Azure Data Lake
- Experience with Spark on Databricks and Delta Lake tables
- Strong experience with programming, specifically Python or Pyspark
- Experience with setting up and working with Devops pipelines.
- Experience with Infrastructure as a code – ARM / Bicep or Terraform is a plus
- Experience with data management and BI Architecture is preferable and so is creating dashboards
- You have excellent communication skills and fluency in spoken and written English