Data Engineer
Description
- Collaborate with business stakeholders to gather requirements and translate them into scalable data solutions
- Design and implement modern data warehouse (DWH) and lakehouse architectures using OneLake, Fabric, and other Azure components
- Develop end-to-end ETL/ELT data pipelines using Microsoft Fabric, Data Factory, and Databricks
- Manage batch and real-time data ingestion from multiple structured and unstructured sources
- Lead the design of metadata-driven ingestion and processing frameworks
- Implement data governance using Azure Purview including metadata management, data cataloging, and lineage tracking
- Work closely with project managers and architects to ensure timely and quality delivery
- Participate in environment provisioning, optimization, and monitoring of the Azure Fabric platform
- Experience working on large-scale cloud-based data warehouses and data lakes
Qualification
Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field
Required Skills
- Understanding of DWH concepts, ETL/ELT pipelines, and data modeling
- Hands-on experience with:
- Microsoft Fabric components: OneLake, Dataflows Gen2, Pipelines, Lakehouses
- Azure Data Factory, Azure SQL, Azure Synapse, Azure Analysis Services
- Azure Purview for data governance
- Power BI for reporting and dashboarding
- Databricks for transformation using PySpark/Spark
- Experience in metadata-driven ingestion, Microsoft Fabric Toolbox, and working with multiple source systems
- Experience in data migration from legacy systems or other cloud platforms to Microsoft Fabric
Nice to Have Skills
- Provisioning and managing Fabric workspaces and environments
- Integration with Power Platform (Power Apps, Power Automate) for low-code/no-code applications
- Familiarity with CI/CD for data pipelines using GitHub Actions or Azure DevOps
Experience
Minimum 2 years of experience in data engineering, data management and data governance role with at least 1 year of hands-on experience working with Azure data services, including 1+ project delivered using Microsoft Fabric