Senior Data Engineer/Analyst

Role: Data Engineer / Analyst
Location: Hyderabad (Hybrid)
Type: Contract-to-Hire (12 months initial contract)

Job Responsibilities

• Design, develop, and maintain data solutions on Azure Databricks using Python, SQL, and PySpark.
• Work extensively with Delta Lake and relational databases to build scalable data pipelines.
• Perform analysis, design, implementation, and automated testing of data solutions.
• Enhance the consistency check engine for sub-ledger data and other tenants.
• Optimize Spark performance for very large datasets (10s of billions of rows, 200+ columns).
• Identify, troubleshoot, and resolve data issues proactively.
• Collaborate with cross-functional teams to ensure data reliability, consistency, and performance.

Requirements

• Bachelor’s or Master’s degree in Computer Science or Electrical Engineering.
• Proven software engineering experience in building complex systems.
• Strong programming skills in Python (core software engineering, not just scripting).
• Hands-on experience with SQL and relational data models.
• Mandatory: Spark / PySpark experience in production projects.
• Good analytical, problem-solving, and debugging skills.
• Self-starter with the ability to work independently and take initiative.
• Strong communication skills – highly proficient in English (both written and verbal).

Job Type: Contractual / Temporary
Contract length: 12 months

Pay: ₹1,512,785.02 - ₹2,561,428.03 per year

Application Question(s):

• What is your Total IT experience?
• Do you have Strong programming skills in Python?
• Do you have Hands-on experience with SQL and relational data models?
• Do you have strong Spark / PySpark experience?
• Do you have notice period of 30 days or less?

Work Location: In person