FIND_THE_RIGHTJOB.

UST

Lead I - DevOps Engineering (Pyspark Developer)

Hyderabad, Pakistan

5 - 7 Years

2 Openings

Bangalore, Hyderabad

Role description

Role Proficiency:

Act under guidance of Lead II/Architect understands customer requirements and translate them into design of new DevOps (CI/CD) components. Capable of managing at least 1 Agile Team

Outcomes:

Interprets the DevOps Tool/feature/component design to develop/support the same in accordance with specifications

Adapts existing DevOps solutions and creates own DevOps solutions for new contexts

Codes debugs tests documents and communicates DevOps development stages/status of DevOps develop/support issues

Select appropriate technical options for development such as reusing improving or reconfiguration of existing components

Optimises efficiency cost and quality of DevOps process tools and technology development

Validates results with user representatives; integrates and commissions the overall solution

Helps Engineers troubleshoot issues that are novel/complex and are not covered by SOPs

Design install configure troubleshoot CI/CD pipelines and software

Able to automate infrastructure provisioning on cloud/in-premises with the guidance of architects

Provides guidance to DevOps Engineers so that they can support existing components

Work with diverse teams with Agile methodologies

Facilitate saving measures through automation

Mentors A1 and A2 resources

Involved in the Code Review of the team

Measures of Outcomes:

Quality of deliverables

Error rate/completion rate at various stages of SDLC/PDLC

# of components/reused

# of domain/technology certification/ product certification obtained

SLA for onboarding and supporting users and tickets

Outputs Expected:

Automated components :

Deliver components that automat parts to install components/configure of software/tools in on premises and on cloud

Deliver components that automate parts of the build/deploy for applications

Configured components:

Configure a CI/CD pipeline that can be used by application development/support teams

Scripts:

Develop/Support scripts (like Powershell/Shell/Python scripts) that automate installation/configuration/build/deployment tasks

Onboard users:

Onboard and extend existing tools to new app dev/support teams

Mentoring:

Mentor and provide guidance to peers

Stakeholder Management:

Guide the team in preparing status updates
keeping management updated about the status

Training/SOPs :

Create Training plans/SOPs to help DevOps Engineers with DevOps activities and in onboarding users

Measure Process Efficiency/Effectiveness:

Measure and pay attention to efficiency/effectiveness of current process and make changes to make them more efficiently and effectively

Stakeholder Management:

Share the status report with higher stakeholder

Skill Examples:

Experience in the design installation configuration and troubleshooting of CI/CD pipelines and software using Jenkins/Bamboo/Ansible/Puppet /Chef/PowerShell /Docker/Kubernetes

Experience in Integrating with code quality/test analysis tools like Sonarqube/Cobertura/Clover

Experience in Integrating build/deploy pipelines with test automation tools like Selenium/Junit/NUnit

Experience in Scripting skills (Python/Linux/Shell/Perl/Groovy/PowerShell)

Experience in Infrastructure automation skill (ansible/puppet/Chef/Powershell)

Experience in repository Management/Migration Automation – GIT/BitBucket/GitHub/Clearcase

Experience in build automation scripts – Maven/Ant

Experience in Artefact repository management – Nexus/Artifactory

Experience in Dashboard Management & Automation- ELK/Splunk

Experience in configuration of cloud infrastructure (AWS/Azure/Google)

Experience in Migration of applications from on-premises to cloud infrastructures

Experience in Working on Azure DevOps/ARM (Azure Resource Manager)/DSC (Desired State Configuration)/Strong debugging skill in C#/C Sharp and Dotnet

Setting and Managing Jira projects and Git/Bitbucket repositories

Skilled in containerization tools like Docker/Kubernetes

Knowledge Examples:

Knowledge of Installation/Config/Build/Deploy processes and tools
- Knowledge of IAAS - Cloud providers (AWS/Azure/Google etc.) and their tool sets
- Knowledge of the application development lifecycle
- Knowledge of Quality Assurance processes
- Knowledge of Quality Automation processes and tools
- Knowledge of multiple tool stacks not just one
- Knowledge of Build Branching/Merging
- Knowledge about containerization
- Knowledge on security policies and tools
- Knowledge of Agile methodologies
Additional Comments:
Description: strong PySpark developer with 4+ years of experience who can handle a complex migration project. After reviewing the current profiles, none appear to meet the level of expertise needed to manage the complexity involved. PSZONE requirement: • Proficient in Apache Spark and PySpark, including Spark SQL, DataFrames, and RDD optimization techniques • Solid programming skills in Python; familiarity with languages like Scala • Extensive experience with cloud platforms, specifically AWS (e.g., EMR, S3, Lambda) • Understanding of DocumentDB, Aurora postgre and distributed computing environments

Skills

Apache Spark,Pyspark,Spark Sql,Python

About UST

UST is a global digital transformation solutions provider. For more than 20 years, UST has worked side by side with the world’s best companies to make a real impact through transformation. Powered by technology, inspired by people and led by purpose, UST partners with their clients from design to operation. With deep domain expertise and a future-proof philosophy, UST embeds innovation and agility into their clients’ organizations. With over 30,000 employees in 30 countries, UST builds for boundless impact—touching billions of lives in the process.

Similar jobs