Module Lead

Experience – 9 to 14 Years

Job Description:

3+ years of experience in Azure Databricks with PySpark.

2+ years of experience in Databricks workflow & Unity Catalog.

2+ years of experience in ADF (Azure Data Factory),

2+ years of experience in ADLS Gen 2

2+ years of experience in Azure SQL.

3+ years of experience in Azure Cloud platform.

2+ years of experience in Python programming & package builds.

Hands-on experience in designing and building scalable data pipelines using Databricks with PySpark, supporting batch and near-real-time ingestion, transformation, and processing. Ability to optimize Spark jobs and manage large-scale data processing using RDD/Data Frame APIs. Demonstrated expertise in partitioning strategies, file format optimization (Parquet/Delta), and Spark SQL tuning.

Skilled in governing and managing data access for Azure Data Lakehouse with Unity Catalog. Experience in configuring data permissions, object lineage, and access policies with Unity Catalog. Understanding of integrating Unity Catalog with Azure AD, external megastores, and audit trails.

Experience in building efficient orchestration solutions using Azure data factory, Databricks Workflows. Ability to design modular, reusable workflows using tasks, triggers, and dependencies. Skilled in using dynamic expressions, parameterized pipelines, custom activities, and triggers. Familiarity with integration runtime configurations, pipeline performance tuning, and error handling strategies.

Good experience in implementing secure, hierarchical namespace-based data lake storage for structured/semi-structured data, aligned to bronze-silver-gold layers with ADLS Gen2. Hands-on experience with lifecycle policies, access control (RBAC/ACLs), and folder-level security. Understanding of best practices in file partitioning, retention management, and storage performance optimization.

Capable of developing T-SQL queries, stored procedures, and managing metadata layers on Azure SQL

Comprehensive experience working across the Azure Cloud ecosystem, including networking, security, monitoring, and cost management relevant to data engineering workloads.

Experience in writing modular, testable Python code used in data transformations, utility functions, and packaging reusable components. Familiarity with Python environments, dependency management (pip/Poetry/Conda), and packaging libraries. Ability to write unit tests using PyTest/unittest and integrate with CI/CD pipelines.

Able to prepare Design documents for development adopting code analyzers and unit testing frameworks.

Why Join WinWire: Your Path to Professional Excellence in the Age of AI

As an Employer of Choice, WinWire offers an exceptional workplace culture, industry recognition, and an unwavering commitment to employee growth. Here is why top talent chooses us:

AI-First. Globally Recognized: Honored at the World Economic Forum in Davos for our pioneering "Agentic AI @ Scale" work, cementing our position as a forward-thinking, AI-first services firm shaping the future of enterprise technology. Read Press Release

Microsoft Gold Standard: A 6x Microsoft Global Partner of the Year Winner/Finalist — reflecting our consistent delivery of industry-leading solutions and our deep, trusted partnership with Microsoft. Learn more about our MSFT relationship

Joining the NTT DATA Family: WinWire is becoming part of NTT DATA, a $30 billion global leader in AI, digital business, and technology services. This means greater career stability, broader client exposure, and access to a vast landscape of opportunities across a truly global organization. Read Press Release

Award-Winning Culture: Certified as a Best Place to Work® four times, our workplace culture is not just a talking point — it is a proven, recognized commitment to creating an environment where people genuinely thrive. Watch video

People-First Environment: With a strong 4.0 Glassdoor rating, our employees speak for themselves. We prioritize wellbeing, inclusivity, and a culture of respect at every level of the organization.

Invest in Your Growth: From continuous learning programs to structured career development pathways, we equip our team with the skills, tools, and opportunities needed to grow and lead in the age of AI.