SW Real Time Data Engineer III - Data Streaming

We are looking for a skilled professional to join our Hyderabad-based team as a vital contributor to the configuration and validation of infrastructure for our SaaS Real-Time Data Streaming Platform hosted on Azure. This role focuses on enhancing data streams using Azure Stream Analytics, applying machine learning techniques such as classification and regression, and developing systems that incorporate OpenAI technologies. The successful candidate will work closely with development teams, data organizations, and application architects to ensure smooth platform operations and continuous improvements.

Key Responsibilities
- Configure and validate infrastructure components related to the SaaS Real-Time Data Streaming Platform on Azure.
- Enrich data streams using Azure Stream Analytics to improve data insights and processing.
- Apply machine learning methods, including classification and regression, to support data workflows.
- Develop and maintain systems integrating OpenAI technologies to automate and optimize processes.
- Collaborate with development teams, Data Organization, and Application Architects to provide ongoing support and ensure platform stability.
- Create and maintain detailed documentation such as knowledge articles and technical guides.
- Act as a regional point of contact within the Data Streaming team, coordinating efforts across different geographic locations.
- Work closely with architecture, development, data, and operations teams to maintain platform efficiency and meet performance goals.
- Support the design and development of streaming pipelines and data models to enhance real-time data processing capabilities.
- Identify and implement architectural and technological improvements to optimize end-to-end data streaming workflows.

Required Qualifications
- Proficiency in programming languages such as C# or Java.
- Hands-on experience with streaming platforms like Kafka, Flink, and Azure Event Hub.
- Strong knowledge of Azure services including Function Apps, Streaming Analytics Jobs, Azure Data Lake Storage (ADLS), Cosmos DB, and Azure Data Factory.
- Familiarity with NoSQL databases, particularly Cosmos DB.
- Experience developing OpenAI applications aimed at automating manual processes.
- Solid understanding of cloud-native development principles and DevOps practices.
- Excellent problem-solving, debugging, and communication skills to collaborate effectively across teams.

Preferred Qualifications and Benefits
- Experience with real-time data processing frameworks such as Apache Flink and Fabric RTI is a plus.
- Competitive salary range of INR 25 to 30 Lakhs per annum.
- This is a full-time position based in Hyderabad, Telangana, India.

Join our innovative team to drive cutting-edge real-time data streaming solutions within a dynamic cloud environment.