Lead II - Data Engineering

7 - 9 Years

1 Opening

Trivandrum

Role description

Design and develop scalable ETL/ELT pipelines using Databricks.
Build and optimize data workflows using Apache Spark (PySpark/Scala).
Implement data transformation and ingestion frameworks for batch and streaming data.
Develop and manage Delta Lake tables using Delta Lake architecture.
Optimize performance of Spark jobs and SQL queries.
Collaborate with Data Scientists, Analysts, and BI teams for data modeling and analytics requirements.
Implement data quality, governance, and security best practices.
Work with orchestration tools like Airflow / ADF / Databricks Workflows.
Monitor, troubleshoot, and optimize production pipelines.
Participate in CI/CD processes for data engineering workflows

Skills

data engineering,databricks,data analysis,data modeling,

About UST

UST is a global digital transformation solutions provider. For more than 20 years, UST has worked side by side with the world’s best companies to make a real impact through transformation. Powered by technology, inspired by people and led by purpose, UST partners with their clients from design to operation. With deep domain expertise and a future-proof philosophy, UST embeds innovation and agility into their clients’ organizations. With over 30,000 employees in 30 countries, UST builds for boundless impact—touching billions of lives in the process.

Similar jobs

No similar jobs found

Term of use Privacy policy