Senior Big Data Engineer

Role Overview

As a Big Data Engineer, you will be responsible for architecting, developing, and maintaining scalable data platforms. You will work on complex data migration projects, particularly transitioning from MySQL to NoSQL, while leveraging AWS cloud-based big data tools.

Key Responsibilities

• Design, develop, and maintain large-scale data processing pipelines using AWS Glue, Spark, and Scala.
• Implement scalable and efficient workflows with AWS Step Functions and EMR.
• Lead and execute data migration projects from MySQL to NoSQL databases.
• Collaborate with data scientists, analysts, and business teams to deliver clean and reliable data solutions.
• Optimize big data processes for performance, scalability, and cost-efficiency.
• Ensure data security, compliance, and governance best practices are followed.

Required Skills & Qualifications

• 5+ years of proven experience as a Big Data Engineer.
• Strong expertise in AWS Glue, Spark, Scala, AWS Step Functions, and EMR.
• Solid hands-on experience with data migration from MySQL to NoSQL (e.g., DynamoDB, MongoDB, Cassandra).
• Proficiency in designing and maintaining ETL pipelines and data integration solutions.
• Strong problem-solving and debugging skills in large-scale data environments.
• Familiarity with modern data architectures and best practices.

Good to Have (Optional)

• Experience with Python or Java for big data applications.
• Knowledge of CI/CD practices for data workflows.
• Exposure to data warehousing and analytics tools.

Why Join Us?

• Opportunity to work on cutting-edge big data projects.
• Collaborative and innovative work culture.
• Career growth and continuous learning environment.
• Competitive salary and benefits package

Job Types: Full-time, Permanent

Pay: Up to ₹2,000,000.00 per year

Benefits:

• Health insurance
• Provident Fund

Work Location: In person