Impressico is seeking an experienced Data Engineer to join their team in Noida or Hyderabad. The ideal candidate will have 5 to 8 years of experience in building and maintaining data ingestion pipelines and orchestrating them for client projects. This role involves designing scalable data architectures, optimizing data delivery, and working with diverse data sources using technologies such as PySpark, SQL, and cloud platforms like AWS or Azure. The candidate will collaborate closely with both internal teams and external stakeholders to resolve data-related technical challenges and support the overall data infrastructure.
Key Responsibilities
- Design, create, and maintain efficient data pipeline architectures to support business needs.
- Optimize data delivery processes to ensure scalability and performance.
- Develop infrastructure for extracting, transforming, and loading data from various sources including databases, streaming platforms, files, and SFTP servers using PySpark, SQL, and cloud services.
- Collaborate with stakeholders to troubleshoot and resolve data-related technical issues.
- Enable and manage data ingestion workflows from multiple sources.
- Conduct thorough testing and validation of data transformations to ensure accuracy and reliability for downstream applications.
- Continuously recommend and implement improvements to enhance data quality and reliability.
Required Qualifications
- Strong coding skills in Python and PySpark.
- Advanced proficiency in SQL querying.
- Hands-on experience with AWS services such as Glue, Lambda, Redshift, Step Functions, Kinesis, SNS, SQS, S3, and EventBridge, or equivalent Azure cloud services.
- Experience in orchestrating data pipelines both on-premises and in cloud environments, including automation and CI/CD processes.
- Practical knowledge of ETL tools, frameworks, and processes.
- Experience working with data warehouses and multiple database systems.
This role offers the opportunity to work on cutting-edge data engineering projects within a dynamic environment, supporting diverse client needs across industries. Candidates who thrive in collaborative settings and have a passion for building robust data solutions will find this position rewarding.
Impressico values innovation and continuous improvement, encouraging team members to contribute ideas that enhance data infrastructure and operational efficiency.
If you meet the experience criteria and are eager to advance your career in data engineering with exposure to cloud technologies and complex data ecosystems, this position is an excellent fit.