Principal Data Engineer - II

We are seeking an experienced Data Engineer to design, develop, and maintain scalable data pipelines and storage solutions that support a variety of business needs. The ideal candidate will work closely with cross-functional teams to transform raw data into actionable insights, ensuring data systems are secure, performant, and reliable. This role requires a strong technical background in big data tools, cloud platforms, and programming, along with excellent collaboration skills to deliver high-quality data solutions in a dynamic environment.

Key Responsibilities

- Design, develop, and maintain scalable ETL/ELT pipelines to ingest, transform, and integrate data from multiple sources.
- Implement both real-time data streaming and batch processing solutions tailored to diverse business requirements.
- Build and optimize data storage architectures, including data lakes, warehouses, and databases.
- Ensure data pipelines and systems are scalable, secure, and deliver high performance.
- Clean, transform, and prepare raw data for analytics and machine learning applications.
- Collaborate with Data Scientists and Analysts to define data requirements and deliver effective solutions.
- Monitor the performance and reliability of data pipelines, proactively implementing improvements.
- Troubleshoot and resolve data-related issues promptly to minimize downtime.
- Implement and enforce data quality checks, validation processes, and monitoring mechanisms.
- Work closely with Data Governance teams to ensure compliance with organizational data standards and policies.
- Partner with Data Architects, Analysts, and Business Teams to understand requirements and deliver tailored data solutions.
- Provide technical expertise and guidance on data engineering best practices.
- Stay current with emerging tools, technologies, and industry trends to continuously enhance data engineering capabilities.
- Evaluate and recommend new technologies to improve data infrastructure and processes.

Required Qualifications

- Bachelor’s or Master’s degree in Computer Science, Data Engineering, Information Systems, or a related field.
- 7 to 8 years of professional experience as a Data Engineer or in a similar role, with proven expertise in building and maintaining data pipelines and infrastructure.
- Hands-on experience with big data tools, cloud platforms, and data integration techniques.
- Strong proficiency in SQL and experience working with both relational and NoSQL databases.
- Experience with data orchestration tools such as Oracle Data Integrator (ODI), SQL Server Integration Services (SSIS), Apache Airflow, dbt, or Prefect.
- Proficiency in programming languages including Python, Java, or Scala.
- Familiarity with data processing frameworks like Apache Spark and Kafka.
- Excellent problem-solving and analytical skills.
- Strong communication and collaboration abilities, capable of working effectively in a fast-paced, team-oriented environment.

Preferred Qualifications and Benefits

- Competitive salary package.
- Fuel card provided as part of employee benefits.
- Comprehensive health benefits to support employee well-being.
- Opportunities for professional development and career growth.
- Inclusive and supportive work culture fostering innovation and teamwork.

This role offers an exciting opportunity to contribute to the development of cutting-edge data solutions within a collaborative and forward-thinking organization. If you are passionate about data engineering and eager to work with the latest technologies, we encourage you to apply.