Senior Data Engineer

Job Title : Senior Data Engineer

Experience : 7-12 Years

Location : Bengaluru

Shift Time : 8:00am to 5:00pm or 1.30pm to 10.30pm

Roles & Responsibilities:

• Design and maintain scalable, automated data pipelines and ETL processes on Microsoft Azure.
  
• Oversee data infrastructure to ensure performance, resiliency, and operational efficiency.
  
• Collaborate with data science, analytics, and architecture teams to deliver high-quality data solutions.
  
• Optimize data workflows for speed, reliability, and scalability.
  
• Ensure data quality using validation frameworks and best practices.
  
• Create and maintain documentation for data processes and configurations.
  
• Troubleshoot and resolve data pipeline issues promptly.
  
• Stay updated with new technologies and implement improvements.
  
• Manage CI/CD processes for deploying and maintaining data solutions.
  
• Guide and mentor junior data engineers.

Requisites:

• Strong knowledge of Azure Data Engineering tools (ADF, Synapse, Databricks, Fabric, Data Lake, Blob).
  
• Proficiency in SQL and working with modern RDBMS.
  
• Solid understanding of software engineering fundamentals (CI/CD, testing, version control).
  
• Experience with big data technologies like Spark.
  
• Strong problem-solving, analytical, and communication skills.
  
• Preferred: Python/Scala/Java, PySpark, modern file formats (Parquet, Delta, Avro), API integrations, Git, Azure DevOps, Ansible.