Sr. Data Engineer
Description
- Collaborate with business stakeholders to gather requirements and translate them into scalable data solutions.
- Discover and Integrate organization wide data sources
- Design and implement modern data warehouse (DWH) and lakehouse architectures using OneLake, Fabric, and other Azure components.
- Develop end-to-end ETL/ELT data pipelines using Microsoft Fabric, Data Factory, and Databricks.
- Manage batch and real-time data ingestion from multiple structured and unstructured sources.
- Lead the design of metadata-driven ingestion and processing frameworks.
- Implement data governance using Azure Purview including metadata management, data cataloging, and lineage tracking.
- Provide technical leadership to the team; mentor junior engineers and contribute to talent development.
- Work closely with project managers and architects to ensure timely and quality delivery.
- Participate in environment provisioning, optimization, and monitoring of the Azure Fabric platform.
Qualification
Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field
Required Skills
- Deep understanding of DWH concepts, ETL/ELT pipelines, and data modeling.
- Hands-on experience with:
- Microsoft Fabric components: OneLake, Dataflows Gen2, Pipelines, Lakehouses
- Azure Data Factory, Azure SQL, Azure Synapse, Azure Analysis Services
- Azure Purview for data governance
- Power BI for reporting and dashboarding
- Databricks for transformation using PySpark/Spark
- Experience in metadata-driven ingestion, Microsoft Fabric Toolbox, and working with multiple source systems.
- Experience in data migration from legacy systems or other cloud platforms to Microsoft Fabric.
Experience
Minimum 5 years of experience in data engineering, data management, and data governance roles. At least 3 years of hands-on experience working with Azure data services, including 1+ project delivered using Microsoft Fabric