azure data engineer

Mind Stream

We are seeking a highly skilled Azure Data Engineer with extensive experience in building, optimizing, and managing scalable data solutions on Microsoft Azure. The ideal candidate will have hands-on expertise in Azure Databricks, Data Factory, Data Lake Storage, and Event Hub, along with strong programming and data engineering skills.Required Skills and Qualifications:<ul><li>8+ years of experience as an Azure Data Engineer or similar role.</li><li>Strong expertise in Azure Databricks, Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), and Event Hub.</li><li>Proficiency in programming languages such as PySpark, Scala, or SQL.</li><li>Experience with data modeling, data warehousing, and big data technologies.</li><li>Knowledge of Delta Lake and other data storage formats.</li><li>Familiarity with data integration tools and techniques.</li><li>Excellent problem-solving skills and attention to detail.</li><li>Knowledge of data governance and data quality best practices.</li><li>Strong communication and collaboration skills.</li><li>Certification in Microsoft Azure Data Engineering or irelated areas is a plus</li><li>Bachelor&rsquo;s degree in Computer Science, Information Technology, or a related field.</li></ul>Job Type: Full-timeApplication Question(s):<ul><li>Do you have a minimum of 8 years of total experience as a Data Engineer or in a similar role?</li><li>How many years of hands-on experience do you have with Azure Databricks?</li><li>How many years of experience do you have working with Azure Data Factory (ADF) and Azure Data Lake Storage (ADLS)?</li><li>Do you have experience with data modeling, data warehousing, and big data technologies?</li><li>What is your current and expected salary?</li><li>What is your notice period?</li></ul>

Azure Data Engineer

Tata Consultancy Services (TCS)

<div></div><div><div><div><div>Inviting Applications for Azure Data Engineer

Job description:

Job Title: Azure DataEngineer

Location: Bangalore

Experience Range: 5-10 yrs

JD: 

<ul>
<li>3+ years of relevant experience in Pyspark and Azure Databricks. &middot; Proficiency in integrating, transforming, and consolidating data from various structured and unstructured data sources. &middot; Good experience in SQL or native SQL query languages. &middot; Strong experience in implementing Databricks notebooks using Python. &middot; Good experience in Azure Data Factory, ADLS, Storage Services, Serverless architecture, Azure functions. &middot; Advanced working knowledge in building robust data pipelines using ADF</li>
</ul></div></div></div><div><div><div>Location</div>
<div>Bengaluru</div>
</div><div><div>Job Function</div>
<div>IT INFRASTRUCTURE SERVICES</div>
</div><div><div>Role</div>
<div>Engineer</div>
</div><div><div>Job Id</div>
<div>381880</div>
</div><div><div>Desired Skills</div>
<div>Azure | SQL</div>
</div></div>Desired Candidate Profile
<div><div>Qualifications : BACHELOR OF ENGINEERING</div></div></div><div></div>

vlitechnologies

Role: Azure Data Engineer (Contractual)<ul><li>Eperience: 8+ Years</li><li>Shift Timing: 11:00 AM &ndash; 8:00 PM</li><li>Budget: 80k - 1L</li><li>Location: Remote</li><li>UAN: Not Mandatory</li><li>Education: B.Tech in Computer Science (Mandatory)</li></ul>Technical Skills RequiredAdvanced SQL, Azure Data Factory (ADF), Databricks (with PySpark)Experience with Azure Synapse (added advantage)Strong understanding of Big Data processing approaches and schema-on-read methodologiesHands-on experience with Azure Data Factory, Azure Databricks (PySpark), and Azure Data Lake Storage (ADLS Gen2)Strong development and coding experience in Python (mandatory &ndash; PySpark) and SQLKnowledge of Power BI DAX (good to have)Proven experience in implementing robust ETL/ELT pipelines within Azure Data Factory or Azure Synapse PipelinesExposure to reporting tools like Power BI or Tableau is a plusOnboarding Requirements:-If selected, please be ready to share:&middot; Aadhar Card&middot; PAN Card&middot; Educational Certificates&middot; Experience Letters&middot; LinkedIn Profile (Need to show currently working as TalentTwins Technologies/Confidential)&middot; No JNTU University resource allowedCompany Terms &amp; Conditions&middot; Contract: 6+ months (extendable)Monthly budget: As per discussion (INR)Work commitment during business hours is mandatoryInvoice-based payment: Paid within 35&ndash;40 days post-invoice (month-end)10% TDS deduction applicableNDA &amp; compliance documentation required upon selectionNo backouts post-confirmation &ndash; acceptance will be treated as a firm commitmentBest,Job Type: Contractual / TemporaryPay: &#8377;90,000.00 per monthExperience:<ul><li>Azure Data engineer : 9 years (Required)</li></ul>Work Location: Remote

Mindstream

Role: Azure Data EngineerLocation: QatarDuration: 1 Year and extendableSalary: Best in marketExperience: 8+ YearsEducation: Bachelor&rsquo;s degree in Computer Science, Information Technology, or a related field.&middot; Strong expertise in Azure Databricks, Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), and Event Hub&middot; Proficiency in programming languages such as PySpark, Scala, or SQL.&middot; Experience with data modeling, data warehousing, and big data technologies.&middot; Knowledge of Delta Lake and other data storage formats.&middot; Familiarity with data integration tools and techniques.&middot; Excellent problem-solving skills and attention to detail.&middot; Knowledge of data governance and data quality best practices.&middot; Strong communication and collaboration skills.&middot; Certification in Microsoft Azure Data Engineering or related areas is a plusForward resume to careers@mind-stream.netWhatsApp 974 30107270Job Type: Permanent

Mobileprogramming

Job Summary:We are looking for a talented and experienced Azure Data Engineer to join our data engineering team in Bangalore. As an Azure Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines, and working with Azure-based data services to ensure the seamless flow of data for analytical and operational purposes. The ideal candidate will have a strong understanding of Azure data platforms, data engineering practices, and be proficient in creating and optimizing data solutions using Azure Data Factory, Azure Synapse Analytics, Azure SQL Database, and other related Azure services.Key Responsibilities:<ul><li>Data Pipeline Development: Design, develop, and maintain efficient and scalable data pipelines in Azure Data Factory (ADF) to integrate data from multiple sources, process data, and load it into target systems.</li><li>Data Integration: Work with various data sources like SQL, NoSQL, Blob Storage, and data lakes to ingest and process data in an efficient and scalable manner.</li><li>Azure Data Services: Utilize Azure Synapse Analytics, Azure Data Lake, Azure SQL Database, Cosmos DB, and other Azure services to build and optimize data architecture and storage solutions.</li><li>ETL/ELT Development: Implement both ETL (Extract, Transform, Load) and ELT (Extract, Load, Transform) processes using Azure tools, ensuring data is processed accurately and efficiently.</li><li>Data Warehousing: Design and maintain cloud-based data warehousing solutions using Azure Synapse Analytics (formerly Azure SQL Data Warehouse) to support reporting, analytics, and data-driven decision-making.</li><li>Performance Tuning: Optimize performance of data pipelines and processes, ensuring they run efficiently, and troubleshoot performance issues.</li><li>Data Modeling &amp; Management: Develop data models for large datasets, ensuring proper schema design, partitioning, indexing, and data governance.</li><li>Automation &amp; Monitoring: Set up automated processes for data pipeline monitoring, error handling, and logging to ensure high data quality and reliability.</li><li>Security &amp; Compliance: Ensure that the data solutions are secure and comply with data privacy regulations (e.g., GDPR, HIPAA) using Azure Security features and best practices.</li><li>Collaboration: Collaborate with data scientists, business analysts, and stakeholders to understand data needs and ensure alignment of data engineering solutions with business objectives.</li><li>Documentation: Maintain comprehensive documentation for data architecture, pipelines, data models, and best practices.</li></ul>Required Skills &amp; Qualifications:<ul><li>Bachelor&rsquo;s degree in Computer Science, Engineering, or a related field (or equivalent experience).</li><li>5+ years of experience in data engineering, with at least 3 years of hands-on experience working with Azure data platforms.</li><li>Strong proficiency in Azure Data Factory (ADF), Azure Synapse Analytics, Azure SQL Database, and Azure Data Lake.</li><li>Solid understanding of ETL and ELT processes and experience with building data pipelines on the cloud.</li><li>Proficient in SQL and experience with query optimization and performance tuning.</li><li>Experience with Azure Databricks, HDInsight, Cosmos DB, and other Azure-based data technologies is a plus.</li><li>Familiarity with Data Lake architectures and the ability to implement solutions for large-scale data processing.</li><li>Strong knowledge of data modeling, data warehousing, and data governance practices.</li><li>Experience working with cloud storage solutions, including Blob Storage and Data Lake Storage.</li><li>Knowledge of Power BI, Azure Analysis Services, or similar tools for data visualization and reporting is a plus.</li><li>Experience with Python, Spark, or Scala for data processing is highly desirable.</li><li>Familiarity with DevOps practices and tools (e.g., Azure DevOps) for data engineering deployments is a bonus.</li><li>Understanding of data security and compliance frameworks in cloud environments.</li></ul>Preferred Skills (Nice to Have):<ul><li>Azure Certification such as Microsoft Certified: Azure Data Engineer Associate.</li><li>Experience with machine learning models and AI workflows integrated with Azure data services.</li><li>Exposure to Big Data technologies such as Hadoop, Spark, or Kafka.</li><li>Familiarity with Agile development methodologies.</li><li>Knowledge of CI/CD pipelines for automating deployments of data engineering solutions.</li><li>Experience with DataOps for better management of data pipelines.</li></ul>Job Type: Full-timePay: &#8377;900,000.00 - &#8377;1,200,000.00 per yearWork Location: In person

<div></div><div><div><div><div>Hiring Azure Data engineer with 5+ years of experience for PAN India

Required Technical Skillset - Azure, Databricks, Data build tool (DBT)

Job Description 


Role Overview:

We are seeking a Data Engineer with strong expertise in dbt (Data Build Tool) as the primary skill and Databricks as a secondary capability. The role focuses on building scalable data transformation workflows, ensuring data quality, and enabling analytics through modern data stack practices. 


Shape 


Key Responsibilities 


Data Modeling and Transformation:

Design, build, and maintain robust and scalable data models using dbt and SQL. Create reusable transformations and ensure data is structured for efficient analysis. 


Pipeline Development:

Develop and optimize ELT pipelines, leveraging dbt for transformations and Databricks for compute and orchestration when needed. 


Quality Assurance:

Implement and manage data quality tests within dbt to ensure data integrity, accuracy, and consistency. 


Documentation and Governance:

Maintain comprehensive documentation for dbt models, data lineage, and dependencies. 


CI/CD and Version Control:

Apply software engineering best practices using Git and set up CI/CD pipelines for automated dbt project deployments. 


Collaboration:

Partner with data analysts, data scientists, and business stakeholders to deliver clean, reliable datasets for BI and ML use cases. 


Shape 


Essential Skills 


Technical Skills: 


dbt (Primary):

Hands-on expertise with dbt Core and dbt Cloud, including writing models, tests, macros, and using the CLI. 


SQL:

Expert-level proficiency in writing complex, efficient SQL queries for data transformation. 


Databricks (Secondary):

Experience with Azure Databricks for data processing and orchestration. Familiarity with Spark is a plus. 


Azure Data Platform:

Knowledge of Azure Synapse Analytics, Azure Data Lake Storage, and Azure Data Factory. 


Programming:

Proficiency in Python for scripting and pipeline automation. Familiarity with Jinja for dbt templating. 


Data Warehousing:

Strong understanding of dimensional modeling, star/snowflake schemas, and data warehousing concepts. 


Version Control &amp; DevOps:

Experience with Git and CI/CD tools (Azure DevOps or similar).
</div></div></div><div><div><div>Location</div>
<div>Bengaluru</div>
</div><div><div>Job Function</div>
<div>TECHNOLOGY</div>
</div><div><div>Role</div>
<div>Developer</div>
</div><div><div>Job Id</div>
<div>378830</div>
</div><div><div>Desired Skills</div>
<div>Azure</div>
</div></div>Desired Candidate Profile
<div><div>Qualifications : BACHELOR OF ENGINEERING</div></div></div><div></div>

CRUTZ LEELA

Azure Data Engineer requiredData Pipeline Development: Design, build, and maintain high-performance, scalable ETL/ELT pipelines using Azure Data Factory,Databricks, and ADLS.&#61623; Data Platform Enhancement: Contribute to the development andoptimization of our Azure-based Data Platform, ensuring efficiency,reliability, and security.&#61623; IoT &amp;amp; High-Volume Data Processing: Work with large-scale IoT andoperational datasets, optimizing data ingestion, transformation, andstorage.&#61623; Data Governance &amp;amp; Quality: Implement data governance bestpractices, ensuring data integrity, consistency, and compliance.&#61623; Performance Optimization: Improve query performance and storageefficiency for analytics and reporting use cases.&#61623; Collaboration: Work closely with data scientists, architects, andbusiness teams to ensure data availability and usability.&#61623; Innovation &amp;amp; Automation: Identify opportunities for automation andprocess improvements, leveraging modern tools and technologies.Here&rsquo;s What You&rsquo;ll Bring with You&#61623; 6+ years of experience in data engineering with a focus on Azurecloud technologies.&#61623; Strong expertise in Azure Data Factory, Databricks, ADLS, andPower BI.&#61623; Proficiency in SQL, Python, and Spark for data processing andtransformation.&#61623; Experience with IoT data ingestion and processing, handling high-volume, real-time data streams.&#61623; Strong understanding of data modeling, lakehouse architectures, andmedallion frameworks.&#61623; Experience in building and optimizing scalable ETL/ELT processes.&#61623; Knowledge of data governance, security, and complianceframeworks.&#61623; Experience with monitoring, logging, and performance tuning of dataworkflows.&#61623; Strong problem-solving and analytical skills with a platform-firstmindset.Job Types: Full-time, PermanentBenefits:<ul><li>Provident Fund</li></ul>Work Location: In person

Search 10000+ Azure data engineer jobs near you this November. New roles added regularly across leading industries. Apply today.

10000 azure data engineer jobs NEAR_ME

Azure Data Engineer

Azure Data Engineer

Azure Data Engineer

Azure Data Engineer

Azure Data Engineer

Azure Data Engineer

Azure Data Engineer