Lead Data Engineer

Architect & Design: Lead the design of data solutions on AWS, selecting the optimal services for data processing (EMR, Glue, EMR Serverless, Lambda), storage (Cassandra, Elasticsearch), and messaging (Kafka, SNS/SES). Build Data Pipelines: Develop, test, and deploy high-quality, scalable data pipelines using PySpark and Scala for both batch and real-time streaming applications. Manage Data Stores: Engineer and optimize OLTP data persistence layer utilizing Cassandra for high-throughput operational workloads and Elasticsearch for search and analytics needs. Implement Streaming Solutions: Build and maintain real-time data backbone using Apache Kafka for event streaming and AWS SNS/SES for asynchronous notifications. Orchestrate Workflows: Create and manage complex, dependent data workflows using orchestration tools like Apache Airflow. Collaborate & Translate: Work closely with product managers and application developers to understand user requirements and translate them into technical specifications and data models. Job Description 2 Optimize Performance & Cost: Proactively monitor, troubleshoot, and optimize data pipelines for performance, scalability, and cost-efficiency

Job Types: Full-time, Permanent

Pay: ₹2,000,000.00 - ₹2,300,000.00 per year