SW Real Time Data Engineer III - Data Streaming

Job Description

• Position Responsibilities Summary:
  
• Configure and validate infrastructure related to our SAAS Real-Time Data Streaming Platform in Azure.
  
• Enrich data with Azure Stream Analytics.
  
• Use Machine Learning techniques like classification and regression.
  
• Develop systems to support applying OpenAI techniques .
  
• Provide support to our development teams and work with our Data Organization
  
• Work with our Application Architects.
  
• Documentation: writes knowledge articles and other documentation

• 
  Serving as a regional point of contact in our Data Streaming team together with members in other regions.
• Work in close coordination with the architecture, development, data and operations team such that the platform functions within expectation.
• Support the development in streaming Pipeline and data models.
• Look for opportunities to improve our end-to-end stream by means of architecture and technology-based changes.

Requirements

• Proficiency in C# or Java
  
• Experience with streaming platforms like Kafka, Flink, and Azure Event Hub
  
• Strong knowledge of Azure services: Function Apps,streaming analytics jobs, ADLS, Cosmos DB and Azure Data Factory
  
• Familiarity with NoSQL databases, especially Cosmos DB.
  
• Experience in developing openAI applications to automate manual processes
  
• Experience in real time data processing using Apache Flink, Fabric RTI good to have.
  
• Understanding of cloud-native development and DevOps practices.
  
• Excellent problem-solving, debugging, and communication skills.