Data Bricks Engineer (Data Bricks Certified)

We are looking for an experienced Databricks Engineer to design, develop, and optimize scalable data engineering solutions leveraging the Databricks Lakehouse Platform. The ideal candidate will possess strong expertise in Databricks, Apache Spark, PySpark, SQL, Delta Lake, and cloud platforms, with a proven track record in building and maintaining enterprise data pipelines. This role requires a hands-on approach to creating efficient ETL/ELT workflows, managing data governance, and ensuring high performance and reliability across data processing environments.

Key Responsibilities

- Design and develop scalable ETL/ELT pipelines using Databricks, Spark, and PySpark technologies.
- Develop and maintain Lakehouse architecture by implementing Delta Lake with Bronze, Silver, and Gold data layers.
- Build both batch and real-time data processing and streaming solutions to support business needs.
- Manage Databricks Jobs, Workflows, and Delta Live Tables (DLT) to automate and streamline data workflows.
- Implement data governance frameworks and access controls using Unity Catalog to ensure data security and compliance.
- Optimize Spark jobs, SQL queries, pipelines, and cloud resource usage to enhance performance and reduce costs.
- Integrate Databricks with various enterprise data sources and cloud platforms such as Azure, AWS, or GCP.
- Establish data quality, validation, monitoring, and error-handling processes to maintain data integrity.
- Support Git-based version control, CI/CD pipelines, and DevOps practices for automated and reliable deployments.
- Troubleshoot production issues promptly and maintain stable data platform operations.
- Collaborate effectively with Data Architects, Developers, Analysts, and business stakeholders to deliver data solutions aligned with organizational goals.

Required Qualifications

- 5 to 10 years of experience in Data Engineering with strong hands-on expertise in Databricks.
- Advanced proficiency in Databricks, Apache Spark, PySpark, and SQL.
- Deep understanding of Delta Lake and Lakehouse architecture principles.
- Practical experience working with Unity Catalog, Databricks Workflows, and Delta Live Tables (DLT).
- Proven experience in both batch and streaming data processing environments.
- Solid knowledge of ETL/ELT processes, data modeling, and data warehousing concepts.
- Experience working with cloud platforms such as Microsoft Azure, Amazon Web Services (AWS), or Google Cloud Platform (GCP).
- Familiarity with Git version control, CI/CD pipelines, and DevOps methodologies.
- Strong analytical, troubleshooting, and problem-solving skills essential for managing complex data systems.

Certifications (Mandatory)

Candidates must hold at least one of the following certifications:
- Databricks Certified Data Engineer – Associate
- Databricks Certified Data Engineer – Professional
- Azure, AWS, or GCP Data Engineering certification

Education

A Bachelor’s degree in Computer Science, Information Technology, Data Engineering, or a related field is required.

This position offers the opportunity to work with cutting-edge data technologies in a collaborative environment, driving innovation and efficiency in enterprise data solutions.