FIND_THE_RIGHTJOB.

UST

Senior Data Engineer

JOB_REQUIREMENTS

Hires in

Not specified

Employment Type

Not specified

Company Location

Not specified

Salary

Not specified

5 - 7 Years

1 Opening

Bangalore

Role description

UST Job Title: Lead I - Software Engineering

Who we are:

At UST, we help the world’s best organizations grow and succeed through transformation. Bringing together the right talent, tools, and ideas, we work with our client to co-create lasting change. Together, with over 30,000 employees in over 25 countries, we build for boundless impact—touching billions of lives in the process. Visit us at .

The Opportunity:

UST is looking for Senior Data Engineer.

Key Roles & Responsibilities:

Design and build a best-in-class robust scalable data platform that can ingest, store, manage and stream massive amounts of data while simplifying its analysis and processing to enable rapid development of high-quality data products and services.

Design, implement and test robust low latency streaming data pipelines using state of the art big data technologies for preparing/curating data that will support various data as a service product.

You will work with various cross functional teams to explore data and figure out all the data wrangling needed to clean, curate the data and build the end-to-end data pipeline per requirements. You will design necessary privacy and security preventive and detective controls into the CICD of each data pipeline.

You will have a strong bias for operational excellence ensuring error handling, restart-ability ensuring data consistency, logging, monitoring and ing is built into the pipeline.

You will drive continual improvements for reliability, performance, scalability, quality and own associated KPI.

You will provide on-call support for the platform and troubleshooting any issues that arise

Qualification:

5+ years of experience in development and operation in production of Cloud native data streaming data systems (with an emphasis on scalability, robustness, data delivery low latency and data privacy and quality control)

5+ years’ experience working in Cloud native real-time streaming data ecosystem such as Spark, Flink, Kinesis, Lambda, Kafka, EMR/EKS platform, Lakehouse platform (i.e Delta.io) Experience in using Databricks Intelligent Platform is a plus.

5+ years of experience in developing optimizing AWS data system architecture: Infrastructure as Code, integration and deployment automation, security.

5+ years of experience in ensuring operation reliability of cloud native data system in production – Particularly experience in deploying and monitoring AWS infrastructure using MSK, EKS clusters in Production.

• 5+ years’ experience with languages like Spark-Scala, Py-Spark and /or Python, Java. • Experience in relational database concepts with a solid knowledge of SQL, SQL Tuning, Big Data NoSQL technologies

Experience in implementing application processing large-scale Geo-spatial data is a plus

Experience with development and deployment of containerized application using Docker, Kubernetes, Helm

Experience in building systems that monitor data losses and data quality control.

Demonstrated knowledge of data structures and algorithms.

Experience in designing foundations of Operational excellence and implementing.

Curiosity and passion to learn with a strong bias to action.

What we believe:

We’re proud to embrace the same values that have shaped UST since the beginning. Since day one, we’ve been building enduring relationships and a culture of integrity. And today, it's those same values that are inspiring us to encourage innovation from everyone, to champion diversity and inclusion and to place people at the centre of everything we do.

Humility:

We will listen, learn, be empathetic and help selflessly in our interactions with everyone.

Humanity:

Through business, we will better the lives of those less fortunate than ourselves.

Integrity:

We honour our commitments and act with responsibility in all our relationships.

Equal Employment Opportunity Statement

UST is an Equal Opportunity Employer. We believe that no one should be discriminated against because of their differences, such as age, disability, ethnicity, gender, gender identity and expression, religion, or sexual orientation.

All employment decisions shall be made without regard to age, race, creed, colour, religion, sex, national origin, ancestry, disability status, veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by federal, state, or local law.

UST reserves the right to periodically redefine your roles and responsibilities based on the requirements of the organization and/or your performance.

To support and promote the values of UST.

Comply with all Company policies and procedures

Skills

Data,Design,CICD

About UST

UST is a global digital transformation solutions provider. For more than 20 years, UST has worked side by side with the world’s best companies to make a real impact through transformation. Powered by technology, inspired by people and led by purpose, UST partners with their clients from design to operation. With deep domain expertise and a future-proof philosophy, UST embeds innovation and agility into their clients’ organizations. With over 30,000 employees in 30 countries, UST builds for boundless impact—touching billions of lives in the process.

Similar jobs