Senior Data Engineer

ShipIn Systems is transforming the maritime industry by providing an AI-powered visual fleet intelligence platform that links onboard video with shore-based teams. This innovative technology turns daily vessel operations into actionable insights, helping to prevent incidents before they escalate. Working with leading shipowners and operators worldwide, ShipIn enhances visibility, accountability, and learning in maritime operations, resulting in safer crews, improved performance, and smarter decision-making across global fleets. If you are passionate about solving complex, real-world challenges and want to develop technology that drives behavioral change and enhances safety on a large scale, this opportunity is for you.

Key Responsibilities

- Design, implement, and optimize data pipelines that operate in on-premises, vessel-based environments, focusing on performance, reliability, and real-time data throughput.
- Take full ownership of the data pipeline lifecycle, from maintaining and stabilizing existing systems to leading architectural redesigns and improvements.
- Develop high-performance pipelines for both streaming and batch processing of large-scale video and telemetry datasets.
- Integrate on-premises pipeline infrastructure with AWS cloud services, managing deployment workflows and publishing pipeline outputs to the cloud.
- Collaborate closely with machine learning and computer vision engineers to deploy and operationalize models in resource-constrained, real-time edge environments.
- Work alongside DevOps, product managers, and algorithm teams to build infrastructure that supports new product features and enhances system performance.
- Write clean, maintainable Python code and actively participate in design and code reviews to uphold high-quality standards.
- Troubleshoot and resolve pipeline issues promptly to minimize downtime on systems that operate continuously at sea.
- Stay updated with the latest developments in data engineering and proactively apply new techniques to improve existing processes.

Required Qualifications

- Minimum of 5 years’ experience designing and managing production data pipelines.
- Strong proficiency in Python, which will be your primary programming language.
- Hands-on experience with PostgreSQL or similar relational databases.
- Solid understanding of integrating machine learning models into large-scale production environments.
- Comfortable working across hybrid architectures, combining on-premises and cloud environments, preferably with AWS.
- Excellent communication and collaboration skills to work effectively with cross-functional teams.

Preferred Qualifications

- Familiarity with Rust or C++ programming languages.
- Experience working with image or video processing pipelines.
- Background in edge or embedded computing environments.

This position is open to candidates currently based in Pakistan.