Principal Data Engineer - II

We are seeking an experienced Data Engineer to design, develop, and maintain scalable data pipelines and storage solutions that support diverse business needs. The ideal candidate will work closely with cross-functional teams to transform raw data into actionable insights, ensuring data systems are secure, performant, and aligned with organizational standards. This role requires a strong technical background, hands-on experience with big data tools, and the ability to collaborate effectively in a fast-paced environment.

Key Responsibilities

- Design, develop, and maintain scalable ETL/ELT pipelines to ingest, transform, and integrate data from multiple sources.
- Implement real-time data streaming and batch processing solutions tailored to business requirements.
- Build and optimize data storage solutions, including data lakes, warehouses, and various databases.
- Ensure data systems and pipelines are scalable, secure, and high-performing.
- Clean, transform, and prepare raw data into usable formats for analytics and machine learning applications.
- Collaborate with Data Scientists and Analysts to define data requirements and deliver effective solutions.
- Monitor the performance and reliability of data pipelines and systems, applying improvements as needed.
- Troubleshoot and resolve data-related issues promptly to minimize downtime.
- Implement and enforce data quality checks, validation processes, and monitoring mechanisms.
- Work closely with Data Governance teams to ensure compliance with organizational data standards and policies.
- Partner with Data Architects, Analysts, and Business Teams to understand requirements and deliver tailored data solutions.
- Provide technical expertise and guidance on data engineering best practices.
- Stay current with emerging tools, technologies, and industry trends to continuously enhance data engineering capabilities.
- Evaluate and recommend new technologies to improve data infrastructure and workflows.

Required Qualifications

- Bachelor’s or Master’s degree in Computer Science, Data Engineering, Information Systems, or a related field.
- 7 to 8 years of experience as a Data Engineer or in a similar role, with proven expertise in building and maintaining data pipelines and infrastructure.
- Hands-on experience with big data tools, cloud platforms, and data integration techniques.
- Strong proficiency in SQL and experience working with both relational and NoSQL databases.
- Experience with data orchestration tools such as ODI, SSIS, Apache Airflow, dbt, or Prefect.
- Proficiency in programming languages including Python, Java, or Scala.
- Familiarity with data processing frameworks like Apache Spark and Kafka.
- Excellent problem-solving and analytical skills.
- Strong communication and collaboration abilities.
- Ability to thrive in a fast-paced, team-oriented environment.

Preferred Qualifications and Benefits

- Competitive salary package.
- Fuel card provided.
- Comprehensive health benefits.
- Opportunities for professional development and growth.
- Inclusive and supportive work culture.
- Additional perks and benefits designed to enhance employee well-being and engagement.

This position offers a challenging and rewarding opportunity to contribute to the data infrastructure of a forward-thinking organization while working alongside talented professionals in a collaborative environment.