Senior Data Engineer

Role: Lead Data Engineer

Location: Chennai

Mode: Hybrid

Type: Permanent

Job Description:

ob Description:

We are looking for a Senior Data Engineer with strong expertise in Scala, Apache Spark, and PySpark to join our team for a high-impact project. The ideal candidate will play a leading role in developing and optimizing big data solutions on cloud-based platforms like Databricks.

Key Responsibilities:

• Develop scalable data pipelines and applications using Scala, Spark, and PySpark
• Collaborate with cross-functional teams to design, build, and maintain robust data solutions
• Optimize data workflows for performance and scalability on Databricks
• Mentor junior team members and provide technical leadership in data engineering practices
• Participate in code reviews and ensure best practices are followed

Required Skills:

• Strong hands-on experience in Scala programming (must-have)
• Solid experience with Apache Spark and Databricks
• Proficient in PySpark and Python
• Experience building and maintaining large-scale data processing systems
• Strong understanding of distributed computing principles
• Ability to write clean, maintainable, and efficient code

Nice to Have:

• Experience with cloud platforms (e.g., Azure, AWS, or GCP)
• Knowledge of ELT/ETL frameworks and data orchestration tools
• Familiarity with CI/CD for data pipelines

Job Type: Permanent

Pay: ₹3,000,000.00 - ₹3,500,000.00 per year

Experience:

• Scala programming : 5 years (Required)
• Spark: 3 years (Required)
• Pyspark: 3 years (Required)
• Spark (Databricks): 3 years (Required)
• Total: 10 years (Required)

Work Location: In person