Azure Databricks – Data Engineer (Requirements)

Must-have

• Strong Python & SQL (data pipelines, transformations)

• Hands-on Azure Databricks (Spark, Delta Lake, Databricks Jobs)

• Apache Spark performance tuning & optimization

• Azure Data Lake (ADLS Gen2) & Blob Storage

• Azure Data Factory (ADF) for orchestration

• Lakehouse architecture (Bronze / Silver / Gold layers)

• Power BI integration with Databricks (Databricks SQL Warehouse, performance-ready data models)

Good to have

• Streaming (Spark Structured Streaming, Event Hubs / Kafka)

• CI/CD with Azure DevOps or GitHub Actions

• Data quality & governance (Unity Catalog, access control)

• Terraform / IaC exposure

Experience

• 4–8 years overall data engineering experience

• 2+ years of hands-on experience with Azure Databricks