Data Engineer

Data Engineer (Mid-Level)

Location: Chicago, IL (Hybrid – 3 days onsite)
Salary: ~$130K – $145K

We’re looking for a hands-on Data Engineer to build and maintain scalable data pipelines and support analytics and AI initiatives. This is a mid-level IC role focused on execution, not architecture or leadership.

Key Responsibilities

• Build end-to-end data pipelines on Azure Databricks
• Develop ETL/ELT and streaming pipelines using Python, SQL, and Spark
• Work with Delta Lake (Bronze/Silver/Gold) and optimize data models
• Ensure data quality, monitoring, and performance tuning
• Collaborate with data, BI, and product teams
• Contribute to CI/CD, testing, and best practices

Required Skills

• 3+ years of data engineering experience
• Strong Python, SQL, and Spark (PySpark)
• Hands-on with Databricks (Lakehouse, Delta Lake, Workflows, Notebooks)
• Experience with data modeling and pipeline development
• Familiarity with cloud platforms (Azure preferred)
• Understanding of CI/CD, version control, and data engineering best practices

Nice to Have

• Experience with ADF, ADLS, Azure DevOps
• Exposure to streaming, AI/ML, or data governance
• Experience in modern data platforms or migrations

Ideal Candidate

• Strong hands-on engineer (not architect/manager)
• Experience owning pipelines end-to-end
• Good problem-solving and communication skills

Pay: $104,790.40 - $145,000.00 per year

Benefits:

• 401(k)
• 401(k) matching
• Dental insurance
• Health insurance
• Life insurance
• Paid time off
• Vision insurance

Application Question(s):

• Can you walk me through a data pipeline you built end-to-end in Databricks, including how you handled data quality, performance optimization, and monitoring?
• How have you implemented the Bronze/Silver/Gold architecture in Delta Lake, and what decisions did you make around schema design and transformation logic?

Experience:

• Databricks Expertise: 5 years (Required)
• Strong Python + PySpark: 5 years (Required)
• Advanced SQL Skills: 5 years (Required)
• Data Pipeline Development: 5 years (Required)

Location:

• Chicago, IL 60606 (Required)

Ability to Commute:

• Chicago, IL 60606 (Required)

Work Location: In person