Specialist - Data Engineering

Role description

We are seeking an experienced AWS Databricks Engineer to join our data engineering team. The ideal candidate will be responsible for designing, developing, and optimising scalable data pipelines and analytics solutions using AWS and Databricks platforms. This role requires strong expertise in cloud-based big data technologies and a deep understanding of data engineering best practices.

Key Responsibilities

• Develop, maintain, and optimise data pipelines and ETL processes leveraging AWS and Databricks.
• Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver robust solutions.
• Implement data quality, data governance, and security best practices in all workflows.
• Monitor and troubleshoot job performance and failures, ensuring high availability and reliability of data processes.
• Automate workflows using Databricks notebooks, jobs, and integration with AWS services such as S3, Redshift, Glue, and Lambda.
• Document technical solutions, workflows, and best practices for future reference.

Required Skills and Qualifications

• Bachelor’s degree in Computer Science, Information Technology, or related field.
• Proven experience with Databricks and AWS data services (e.g., S3, Redshift, Glue, EMR).
• Proficiency in Python, Scala, or SQL for data engineering tasks.
• Hands-on experience with Spark for large-scale data processing.
• Strong understanding of ETL concepts, data warehousing, and data modelling.
• Familiarity with CI/CD pipelines and version control systems such as Git.
• Excellent problem-solving skills and attention to detail.

Preferred Qualifications

• AWS or Databricks certification.
• Experience with real-time data processing and streaming (e.g., Kafka, Kinesis).
• Knowledge of data security and compliance standards relevant to cloud data solutions.

Strong communication and collaboration skills.

Skills
Mandatory Skills : Databricks

About LTM
LTM is an AI-centric global technology services company and the Business Creativity partner to the world’s largest and most disruptive enterprises. We bring human insights and intelligent systems together to help clients create greater value at the intersection of technology and domain expertise. Our capabilities span integrated operations, transformation, and business AI — enabling new ways of working, new productivity paradigms, and new roads to value. Together with over 87,000 employees across 40 countries and our global network of partners, LTM — a Larsen & Toubro company — owns business outcomes for our clients, helping them not just outperform the market, but to Outcreate it. Please also note that neither LTM nor any of its authorized recruitment agencies/partners charge any candidate registration fee or any other fees from talent (candidates) towards appearing for an interview or securing employment/internship. Candidates shall be solely responsible for verifying the credentials of any agency/consultant that claims to be working with LTM for recruitment. Please note that anyone who relies on the representations made by fraudulent employment agencies does so at their own risk, and LTM disclaims any liability in case of loss or damage suffered as a consequence of the same. Recruitment Fraud Alert - https://www.ltimindtree.com/recruitment-fraud-alert/