We are looking for a seasoned Senior Data Engineer with over seven years of experience specializing in the development and maintenance of data platforms on Microsoft Azure. The successful candidate will have a strong background in designing scalable and efficient data pipelines, managing both data warehouses and data lakes, and supporting enterprise-level reporting and analytics initiatives. This role requires a hands-on professional who can contribute to building robust data infrastructure that drives business insights and decision-making.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines and ETL processes on Microsoft Azure.
- Manage and optimize data warehouses and data lakes to ensure high performance and reliability.
- Collaborate with data scientists, analysts, and business stakeholders to enable effective data reporting and analytics.
- Implement best practices for data governance, security, and compliance within the Azure environment.
- Monitor and troubleshoot data platform issues, ensuring minimal downtime and data integrity.
- Continuously evaluate and integrate new tools and technologies to improve data platform capabilities.
- Document data architecture, workflows, and processes to support knowledge sharing and operational continuity.
Required Qualifications
- Minimum of 7 years of professional experience as a Data Engineer or in a similar role.
- Extensive hands-on experience with Microsoft Azure data services, including Azure Data Factory, Azure Synapse Analytics, Azure Data Lake Storage, and Azure SQL Database.
- Proven ability to design and implement scalable data pipelines and ETL workflows.
- Strong knowledge of data warehousing concepts, data modeling, and big data technologies.
- Proficiency in SQL and programming languages such as Python or Scala for data manipulation and automation.
- Experience with enterprise reporting tools and analytics platforms.
- Solid understanding of data governance, security standards, and compliance requirements.
- Excellent problem-solving skills and the ability to work independently or as part of a cross-functional team.
Preferred Qualifications and Benefits
- Experience with cloud infrastructure automation and infrastructure-as-code tools.
- Familiarity with containerization and orchestration technologies like Docker and Kubernetes.
- Knowledge of machine learning workflows and integration with data platforms.
- Opportunity to work in a dynamic environment with cutting-edge technologies.
- Competitive salary and benefits package tailored to attract top talent.
This position offers a challenging yet rewarding opportunity to contribute to a forward-thinking organization that values innovation and data-driven decision-making. If you are passionate about building scalable data solutions on Microsoft Azure and thrive in a collaborative environment, we encourage you to apply.