Required CertificationsDatabricks Certified Data Engineer Professional
Role requirements
7+ years of experience building highly reliable ETL pipelines and managing complex data workflows. Elite-level proficiency with Apache Spark, Delta Lake architecture, and deploying optimized data infrastructure in production environments.
Technical requirements
Core Architecture: Delta Lake, Medallion Architecture (Bronze/Silver/Gold), Unity Catalog
Engines: PySpark, Spark SQL, Photon Engine, Delta Live Tables (DLT)
Orchestration: Databricks Workflows, dbt (Data Build Tool), Airflow
Performance: Z-Ordering, Liquid Clustering, Data Skipping, and Spark UI Debugging
Focus areas
DatabricksSparkDelta Lake
Ready to apply for this role?
Apply for Principal Data Engineer (Databricks)Don't see the perfect fit?
We're always looking for exceptional people. Send us your CV and tell us how you'd contribute to the DAI mission.