Data Engineer / Data Architect (Azure Databricks)

We are looking for a highly experienced IT Consultant for the role of Data Engineer / Data Architect to join a long-term Azure data platform modernization initiative. The project focuses on building a modern Azure Data Lakehouse architecture based on Databricks, leveraging the Medallion Architecture approach (Bronze / Silver / Gold).

Responsibilities:

• Analyze the existing environment (Databricks, ADF, SQL Server) and identify delivery gaps
• Design and validate the Data Lakehouse architecture (Medallion: Bronze / Silver / Gold)
• Build and enhance Azure Data Factory pipelines (batch ingestion, incremental loads)
• Migrate SQL Server views and business logic into Databricks SQL
• Implement the Gold layer (analytical models, fact/dimension structures)
• Design and maintain CI/CD pipelines in Azure DevOps (ADF Databricks deployments)
• Build data reconciliation and testing frameworks to validate data accuracy
• Support delivery planning and participate in client-facing technical sessions as a subject matter expert
• Report progress and manage dependencies on the client side, including escalation of blockers

Requirements:

• Strong experience with Azure Data Factory (ADF) and Azure Data Lake Storage Gen2
• Hands-on experience with Databricks (SQL, Delta Lake, Medallion architecture)
• Experience with Unity Catalog and RBAC
• Strong SQL Server / T-SQL background, including data migration experience
• Experience in data modeling (fact/dimension, lakehouse architecture)
• Strong Python skills (pipelines, testing, automation)
• Experience with Azure DevOps CI/CD for data platforms
• Ability to work in consulting / client-facing environments
• Experience in end-to-end data platform modernization projects

Nice to have:

• Microsoft Purview
• Databricks Lakeflow
• Experience in recovery / turnaround projects