Senior Azure Data Engineer

We are looking for a skilled Data Engineer to join our team, focusing on the expansion and optimization of big data pipelines. This role involves close collaboration with engineers and developers across various layers of the data warehouse. Success in this position requires a strong dedication to collaborative problem-solving, thoughtful design, and delivering high-quality, scalable solutions.

Key Responsibilities

- Work alongside Big Data Solution Architects to design, prototype, implement, and optimize data ingestion pipelines that facilitate efficient data sharing across multiple business systems.
- Develop and maintain ETL/ELT ingestion pipelines and analytics solutions using cloud-based technologies.
- Ensure all designs, code, and procedures meet production readiness standards, emphasizing operational efficiency, security, and compliance.
- Participate in daily project and production delivery meetings, providing technical support to accelerate issue resolution.
- Collaborate with stakeholders to gather requirements and translate them into effective technical solutions.

Required Qualifications

- Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related discipline, or equivalent professional experience.
- At least 3 years of experience in data engineering and data warehousing, with a focus on building large-scale data pipelines.
- Minimum 2 years of hands-on experience with Big Data distributed systems such as Microsoft Fabric, Databricks, or AWS EMR.
- Proficient in developing data pipelines using PySpark and ETL tools like Azure Data Factory (ADF) or Talend.
- Strong programming skills in Python and SQL.
- Proven problem-solving and critical thinking capabilities.
- Experience writing maintainable unit and integration tests for ingestion pipelines.
- Familiarity with CI/CD pipelines to automate deployment processes.
- Working knowledge of version control systems, particularly Git.
- Understanding of security best practices, including encryption of sensitive data both at rest and in transit.

Preferred Qualifications and Benefits

Our team comprises over 700 talented professionals engaged in innovative enterprise projects and products. We serve a diverse clientele, including Fortune 100 retail and consumer packaged goods companies, leading store chains, fast-growing fintech firms, and multiple Silicon Valley startups.

Confiz is distinguished by its commitment to process excellence and a vibrant workplace culture. The company holds several important certifications, including ISO 9001:2015 (Quality Management System), ISO 27001:2022 (Information Security Management System), ISO 20000-1:2018 (IT Service Management), ISO 14001:2015 (Environmental Management System), and ISO 45001:2018 (Occupational Health and Safety Management System).

At Confiz, employees work with cutting-edge technologies while contributing to both company success and their own professional growth. The culture promotes continuous learning through collaboration and ensures a fun and engaging work environment.

To learn more about Confiz Limited and its values, please visit their LinkedIn page.