Senior Data Engineer

UTIS LLC, a specialized Data Analytics consulting firm, is seeking a Senior Data Engineer for a longterm engagement at our client ASML’s Wilton, Connecticut facility. In this role, you will work closely with the Data Architect to design and implement a secure, scalable Azure Databricks-based data platform that consolidates and processes diverse data types from enterprise source systems — including SAP, image repositories, sensor telemetry, and real-time streaming data.

Key Responsibilities

• Work in close partnership with the Data Architect, contributing to platform design decisions and upholding architectural standards.
• Conduct peer code reviews, provide technical mentorship to junior team members where applicable, and promote engineering best practices.
• Proactively identify risks, dependencies, and technical blockers, escalating appropriately with recommended mitigation strategies.
• Design and build end-to-end data ingestion pipelines on Azure Databricks for structured, semistructured, and unstructured data sources, including SAP transactional data, sensor telemetry, image data, and streaming event data.
• Architect and implement medallion (bronze/silver/gold) layer patterns within the Databricks Lakehouse to support analytics and downstream consumption.
• Develop and maintain production-grade Python-based ETL/ELT pipelines and notebooks with rigorous standards for performance, reliability, and maintainability.
• Design and implement a secure execution framework within Azure Databricks that allows proprietary and confidential Python scripts to run as isolated black boxes, ensuring that even internal platform developers have no access to the data or logic being processed.
• Serve as a technical point of contact for client stakeholders, managing expectations through clear and consistent communication throughout the project lifecycle.
• Translate ambiguous business requirements into precise technical specifications; proactively identify gaps, challenge assumptions, and push back constructively where requirements are incomplete or technically infeasible.
• Facilitate requirement workshops and technical review sessions, bridging the communication gap between business users and engineering teams.

Required Qualifications

• Extensive hands-on experience with Azure Databricks, including cluster management, Delta Lake, Unity Catalog, Databricks Workflows, and Databricks SQL.
• Expert-level Python development skills with experience building production data pipelines, automation scripts, and secure execution frameworks.
• Strong experience handling diverse data types: structured relational data, unstructured image data, high-frequency sensor data, and streaming/event-driven data.

Preferred Qualifications

• Experience in the semiconductor industry is a major plus — familiarity with semiconductor manufacturing workflows, equipment data, or fab operations will distinguish your application.
• Experience in manufacturing environments more broadly (automotive, aerospace, industrial, or similar) is also a significant advantage, particularly where sensor data, equipment telemetry, or process data pipelines were involved.
• Experience integrating SAP as a data source, including extraction patterns for transactional and master data, is a plus.

Work Environment

This is a fully on-site role at ASML’s Wilton, Connecticut, facility. You will be engaged as an employee or contractor of UTIS LLC, embedded within the client’s project team and working alongside the Data Architect and client stakeholders across technical and business functions. Compensation is competitive and commensurate with experience. Due to the nature of the data involved, strict confidentiality requirements apply. The successful candidate will be expected to operate within those constraints with professionalism and discretion throughout the engagement.