FIND_THE_RIGHTJOB.

Lead Bigdata Engineer - Vice President

India

Role Overview:
We are looking for a Big Data Engineer with expertise in PySpark and Apache Iceberg to design and implement scalable data pipelines. The candidate will work on processing large datasets, optimizing data workflows, and ensuring data quality and reliability.

Key Responsibilities:

Design, develop, and maintain big data pipelines using PySpark and Apache Iceberg.
Optimize data workflows for performance and scalability.
Implement data transformation, cleansing, and enrichment processes.
Collaborate with data scientists and analysts to deliver actionable insights.
Ensure data quality, consistency, and security across all pipelines.
Monitor and troubleshoot data pipeline issues in production.

Required Skills:

Programming Languages: Python, PySpark
Data Lake Table Format: Apache Iceberg
Data Orchestration: Apache Airflow
Data Visualization: Tableau
Big Data Processing: Apache Spark
Databases: SQL (relational and NoSQL)
Cloud Platforms: AWS, Azure, GCP (familiarity)

Qualifications:

12 - 15 years of relevant experience in Apps Development or systems analysis role
Extensive experience system analysis and in programming of software applications
Experience in managing and implementing successful projects
Subject Matter Expert (SME) in at least one area of Applications Development
Ability to adjust priorities quickly as circumstances dictate
Demonstrated leadership and project management skills
Consistently demonstrates clear and concise written and verbal communication

Education:

Bachelor’s degree/University degree or equivalent experience
Master’s degree preferred

This job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required.

Job Family Group:

Technology

Job Family:

Applications Development

Time Type:

Full time

Most Relevant Skills

Please see the requirements listed above.

Other Relevant Skills

For complementary skills, please see above and/or contact the recruiter.

Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.

If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi.

View Citi’s EEO Policy Statement and the Know Your Rights poster.

Similar jobs