FIND_THE_RIGHTJOB.
India
Role Proficiency:
Act creatively to develop applications and select appropriate technical options optimizing application development maintenance and performance by employing design patterns and reusing proven solutions account for others' developmental activities
Outcomes:
Measures of Outcomes:
Outputs Expected:
Code:
Documentation:
Configure:
Test:
Domain relevance:
Manage Project:
Manage Defects:
Estimate:
Manage knowledge:
Release:
Design:
Interface with Customer:
Manage Team:
Certifications:
Skill Examples:
Knowledge Examples:
The ADF Developer is primarily responsible for designing, developing, implementing, and maintaining data integration solutions using Microsoft Azure Data Factory (ADF) as the core technology. Experience with Azure Databricks (ADB) is a plus. This role demands strong expertise in ADF, ADB, ETL processes, and data engineering within the Azure cloud ecosystem to support the organization’s data management and analytics initiatives. Key Responsibilities: Solution Development: • Collaborate with data architects, analysts, and stakeholders to gather requirements and design robust data integration solutions. • Develop and implement ETL processes, data pipelines, and workflows primarily using Azure Data Factory. • Leverage ADB where applicable to support advanced data transformation or analytics use cases. • Write and optimize code in languages such as Python, SQL, and Scala for efficient processing of large data sets. ADF-Focused Implementation: • Configure and deploy ADF pipelines, datasets, and linked services to manage data movement and transformation. • Use Azure Databricks as needed for scalable data processing, though ADF remains the central orchestration tool. • Ensure reliable and timely execution of data workflows through proper scheduling and orchestration. Data Quality and Testing: • Develop and execute test plans to validate data quality, accuracy, and completeness. • Troubleshoot data pipeline issues and ensure ETL reliability across the board. • Implement robust data validation and error-handling mechanisms. Performance Optimization: • Identify and resolve performance bottlenecks within ADF pipelines and SQL/Databricks queries. • Continuously optimize data processing to enhance speed, scalability, and efficiency. Collaboration: • Work cross-functionally with data scientists, analysts, and business users to align on requirements and deliverables. • Collaborate with DevOps and infrastructure teams for smooth CI/CD and deployment practices. Documentation: • Maintain clear and up-to-date documentation of technical designs, data flows, and pipeline logic. • Ensure documentation is shared and accessible for future enhancements and support. Training and Support: • Support users in understanding the data integration solutions developed. • Resolve data pipeline or processing issues with minimal impact on business operations. Required Qualifications: • Bachelor’s or Master’s degree in Computer Science, Information Systems, or related field. • 7+ years of strong, hands-on experience with Azure Data Factory. • Familiarity or working experience with Azure Databricks is a big plus. • Proficiency in Python, SQL, and/or Scala. • Solid understanding of ETL processes, data modeling, and data warehousing. • Experience with Azure cloud technologies. • Strong problem-solving, communication, and collaboration skills. Preferred Qualifications: • Microsoft Certified: Azure Data Engineer Associate or similar certification. • Experience with big data tools such as Spark or Hadoop. • Familiarity with data governance, security, and compliance. • Knowledge of Agile practices and version control tools like Git. • Exposure to projects in domains like finance, healthcare, or retail.
Adf,Adb,Ms Sql Server
Similar jobs
JPMorganChase
India
9 days ago
LexisNexis Risk Solutions
India
9 days ago
RELX Group
India
9 days ago
Elsevier
India
9 days ago
SAP
India
9 days ago
MSD
India
10 days ago
Bank of America
India
10 days ago
© 2025 Qureos. All rights reserved.