We are looking for a Senior Data Engineer to join our team and take ownership of designing, building, and maintaining scalable data pipelines using cloud technologies and ETL tools. The ideal candidate will have extensive experience in architecting efficient data workflows and ensuring data quality and security across complex systems. This role requires a strong focus on performance optimization and the implementation of best practices in data engineering.
Key Responsibilities
- Architect and implement high-performance ETL/ELT pipelines using Azure Data Factory.
- Optimize data workflows with a focus on cost efficiency, speed, and scalability to support growing business needs.
- Ensure data quality, lineage, and security are maintained consistently across all data systems.
- Establish and enforce standards for CI/CD processes, monitoring, and documentation within the data engineering team.
Required Qualifications
- Minimum of 5 years of experience in data engineering, including at least 2 years in a senior or lead role.
- Strong expertise with cloud data services such as Redshift, BigQuery, Snowflake, Synapse, or Databricks is essential.
- Proficiency in at least one ETL tool, for example, dbt, Airflow, Glue, Talend, or Fivetran.
- Advanced skills in SQL and programming languages such as Python or Scala.
- Demonstrated experience applying best practices including code reviews, version control using Git, data testing, partitioning strategies, and incremental data loads.
- Experience working with streaming technologies like Kafka or Kinesis is required.
This position offers the opportunity to work with cutting-edge cloud data platforms and contribute to the development of scalable, reliable data infrastructure. Candidates who thrive in a collaborative environment and are passionate about data engineering best practices will find this role rewarding.