Senior Data Engineer (Kafka & AWS) || 6-9 Years || Pune
Responsibilities:
- Develop and maintain real-time data pipelines using Apache Kafka (MSK or Confluent) and AWS services.
- Configure and manage Kafka connectors, ensuring seamless data flow and integration across systems.
- Demonstrate strong expertise in the Kafka ecosystem, including producers, consumers, brokers, topics, and schema registry.
- Design and implement scalable ETL/ELT workflows to efficiently process large volumes of data.
- Optimize data lake and data warehouse solutions using AWS services such as Lambda, S3, and Glue.
- Implement robust monitoring, testing, and observability practices to ensure reliability and performance of data platforms.
- Uphold data security, governance, and compliance standards across all data operations.
Requirements:
- Minimum of 5 years of experience in Data Engineering or related roles.
- Proven expertise with Apache Kafka and the AWS data stack (MSK, Glue, Lambda, S3, etc.).
- Proficient in coding with Python, SQL, and Java — with Java strongly preferred.
- Experience with Infrastructure-as-Code (IaC) tools (e.g., CloudFormation) and CI/CD pipelines.
- Excellent problem-solving, communication, and collaboration skills.
- Flexibility to write production-quality code in both Python and Java as required.
Job Type: Full-time
Pay: Up to ₹2,700,000.00 per year
Application Question(s):
- In which city are you currently based? This answer should match the city mentioned on your CV failing which, your application will not be considered.
- This is an "in-office" job located in Pune. Please apply ONLY IF you are willing to go to the office in Pune all 5 days a week. There is NO remote/ WFH option available.
- What is your notice period (in days)?
- What is your current annual salary?
- What is your expected annual salary?
Experience:
- Apache Kafka (MSK or Confluent): 6 years (Required)
- Data Engineering: 6 years (Required)
- Java: 6 years (Required)
- Infrastructure-as-Code (IaC) tools: 6 years (Required)
- AWS data stack: 6 years (Required)
- Python: 6 years (Required)
- SQL: 6 years (Required)
Location:
- Pune, Maharashtra (Required)
Work Location: In person