Databricks Data Engineer

Mandatory skills: Databricks, Spark, Azure, Python, Cosmos DB, Azure DevOps (GitHub, CI/CD pipelines, Boards etc.), Docker & Azure Kubernetes Service, Graffana, JUnit, Postman, SonarQube
Additional Skills: 3–6 years of experience in data engineering on cloud data platforms. Hands‑on experience building Spark jobs with Scala/Spark and/or PySpark on Databricks. Experience ingesting data from batch and streaming sources into ADLS Gen2 using Delta or Apache Iceberg tables. Good SQL skills for joins, aggregations, and data quality checks. Understanding of core Azure data services (Event Hubs/Kafka, Data Factory/Databricks Workflows, Key Vault). Experience working with Git‑based workflows and CI/CD in Azure DevOps or GitHub.
Good to have skills: Exposure to Spark Structured Streaming for near real‑time use cases. Experience with data quality tools or frameworks and writing unit/integration tests for data pipelines. Familiarity with data modeling and performance considerations in Lakehouse environments.

Roles & Responsibilities:

Responsible for building data products in Databricks using Scala/Spark
Responsible for Ops work managing production for the data products developed and deployed to production
Responsible for testing data products based on product specification and end to end validation
Set up monitoring, logging, and alerting Spark jobs and data pipelines using Azure Monitor/Log Analytics or similar tools
Coordinate with offshore team in India

TCS Employee Benefits Summary:

Discretionary Annual Incentive.
Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans.
Family Support: Maternal & Parental Leaves.
Insurance Options: Auto & Home Insurance, Identity Theft Protection.
Convenience & Professional Growth: Commuter Benefits & Certification & Training Reimbursement.
Time Off: Vacation, Time Off, Sick Leave & Holidays.
Legal & Financial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing.

Salary Range-$90,000-$100,000 a year

Location

Deerfield, IL

Job Function

TECHNOLOGY

Role

Engineer

Job Id

398935

Desired Skills

Azure

Salary Range

$90,000-$100,000 a year

Similar jobs

Amazon Web Services

Sunnyvale, United States

10 days ago

Verus Research

United States

10 days ago

Dennis Group Salt Lake City

Salt Lake City, United States

10 days ago

Intuit

New York, United States

10 days ago

Boeing

North Charleston, United States

10 days ago

Marathon Petroleum

Garyville, United States

10 days ago

SteelCell of North America, Inc.

Baldwin Park, United States

10 days ago