Data Ops Engineer

Must Have Technical/Functional Skills

Technical Skills

Strong hands-on experience with HDFS, Spark, Hive/Impala, and Python-based data processing.
Expertise in debugging ingestion failures, pipeline issues, and performance bottlenecks.
Knowledge of workflow orchestrators such as Airflow, Oozie, ADF.
Experience with Git, artifact management, and CI/CD tools (Azure DevOps/Jenkins).
Incident management: triage, RCA, remediation; ability to handle on-call rotation.
Monitoring using Cloudera Manager, logs, and metrics with focus on SLA/MTTR.
Strong Shell scripting skills and automation of operational tasks.
Basic understanding of Azure/Databricks jobs, clusters, storage.

Functional Skills

Strong analytical thinking and structured problem-solving.
Ability to document runbooks and operational playbooks clearly.
Effective communication with cross-functional teams including release management and offshore teams.
Good understanding of production governance and stability requirements.

Roles & Responsibilities

Monitor and troubleshoot data ingestion/transformation workflows across hybrid environments.
Manage job schedules, track failures, and implement fixes to ensure smooth pipeline execution.
Automate repetitive operational tasks and contribute to CI/CD improvements.
Collaborate with platform engineers, release managers, and global teams for stable releases.
Perform RCA, maintain SLAs, and continuously optimize performance.
Maintain operational documentation, runbooks, and health-check procedures.

TCS Employee Benefits Summary:

Discretionary Annual Incentive.

Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans.

Family Support: Maternal & Parental Leaves.

Insurance Options: Auto & Home Insurance, Identity Theft Protection.

Convenience & Professional Growth: Commuter Benefits & Certification & Training Reimbursement.

Time Off: Vacation, Time Off, Sick Leave & Holidays.

Legal & Financial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing.

Salary Range: $100,000 - $125,000 a year

Location

Jersey City, NJ

Job Function

TECHNOLOGY

Role

Engineer

Job Id

402107

Desired Skills

Azure | Spark

Salary Range

$100,000-$125,000 a year

Desired Candidate Profile

Qualifications : BACHELOR OF COMPUTER SCIENCE

Similar jobs

No similar jobs found