senior data engineer

Coducer Technologies Private Limited

Senior Data Engineer, Azure DatabricksJob Summary: We are seeking a highly skilled Senior Data Engineer with 3-5 years of professional experience, specializing in the Azure Databricks platform. The ideal candidate will have a strong track record of designing, building, and optimizing scalable data pipelines. You will play a crucial role in enhancing our data infrastructure to support critical business intelligence and advanced analytics.Key Responsibilities:<ul><li>Design, develop, and maintain robust data pipelines on Azure Databricks using PySpark.</li><li>Implement and manage ETL/ELT processes for both batch and streaming data.</li><li>Work with data scientists and analysts to understand their data requirements and deliver reliable data solutions.</li><li>Optimize Databricks clusters and jobs for performance and cost efficiency.</li><li>Ensure data quality, integrity, and security across all data pipelines.</li></ul>Required Skills &amp; Qualifications:<ul><li>Bachelor's degree in Computer Science, Engineering, or a related field.</li><li>3-5 years of demonstrable experience as a Data Engineer with a strong focus on Azure Databricks.</li><li>Proficient in PySpark and the Spark ecosystem.</li><li>Experience with Delta Lake for building data lakes and managing ACID transactions is a must.</li><li>Strong command of SQL and solid understanding of data warehousing concepts.</li><li>Hands-on experience with other Azure data services, including Azure Data Lake Storage (ADLS) and Azure Synapse Analytics.</li><li>Excellent problem-solving and communication skills.</li></ul>Job Types: Full-time, PermanentPay: &#8377;1,000,000.00 - &#8377;1,200,000.00 per yearBenefits:<ul><li>Paid sick time</li><li>Paid time off</li></ul>Work Location: In person

Senior Data Engineer

NorthBay - Pakistan

<div>
 
 Job Title:
 
 Senior Data Engineer
 
 
 
 Location:
 
 Abu Dhabi, UAE (Onsite)
 
 
 
 Employment Type:
 
 Full-Time, Permanent
 
 
 
 About The Role
 
 
 
 We are seeking a highly skilled
 
 Senior Data Engineer
 
 with 7&ndash;10+ years of experience to join our team in Abu Dhabi. The ideal candidate will have deep expertise in building and optimizing scalable data pipelines, working with large datasets, and leveraging modern cloud-based technologies. This is an onsite role offering the opportunity to work on cutting-edge data engineering initiatives, including data preparation for advanced analytics, ML, and GenAI use cases.
 
 
 
 Key Responsibilities
 
 
 
 <ul>
 <li>
 Design, build, and maintain scalable, reliable, and high-performance data pipelines.
 </li>
 <li>
 Develop and optimize ETL/ELT processes to handle large-scale structured and unstructured data.
 </li>
 <li>
 Implement data models and warehouse solutions with a focus on Snowflake.
 </li>
 <li>
 Integrate and process data from diverse sources including SQL and NoSQL databases.
 </li>
 <li>
 Ensure data quality, governance, and security standards are maintained across all systems.
 </li>
 <li>
 Collaborate with data scientists and ML engineers to prepare data for advanced analytics and GenAI models.
 </li>
 <li>
 Work closely with business stakeholders to translate requirements into data engineering solutions.
 </li>
 <li>
 Monitor, troubleshoot, and optimize data workflows for performance and cost efficiency.
 
 
 </li>
 </ul>
 
 Required Skills &amp; Qualifications
 
 
 
 <ul>
 <li>
 Experience: 7&ndash;10+ years of professional experience in data engineering.
 </li>
 <li>
 Programming: Proficiency in Python (mandatory).
 </li>
 <li>
 Data Engineering: Strong SQL expertise; experience with NoSQL databases; advanced skills in data modeling, ETL/ELT processes, and orchestration tools (e.g., Airflow, cloud-native services).
 </li>
 <li>
 Cloud: Hands-on experience with cloud data warehousing, data lakes, and related services (mandatory).
 </li>
 <li>
 Snowflake: Proven experience designing and managing data pipelines/warehousing in Snowflake.
 </li>
 <li>
 Big Data: Experience handling large volumes of structured and unstructured data.
 </li>
 <li>
 Desired Skills: Exposure to preparing data for ML/GenAI workloads; familiarity with data governance and data quality frameworks.
 
 
 </li>
 </ul>
 
 Why Join Us
 
 
 
 <ul>
 <li>
 Opportunity to work onsite in Abu Dhabi on high-impact data engineering projects.
 </li>
 <li>
 Collaborative work environment with cross-functional teams in cloud, data, and ML domains.
 </li>
 <li>
 Chance to contribute to the modernization of enterprise data platforms with cutting-edge technologies.
 </li>
 </ul>
</div>

NorthBay Solutions

<div>Job Title: Senior Data Engineer 
Location: Abu Dhabi, UAE (Onsite) 
Employment Type: Full-Time, Permanent<h3 class="jobSectionHeader">
About the Role</h3>
We are seeking a highly skilled Senior Data Engineer with 7&ndash;10+ years of experience to join our team in Abu Dhabi. The ideal candidate will have deep expertise in building and optimizing scalable data pipelines, working with large datasets, and leveraging modern cloud-based technologies. This is an onsite role offering the opportunity to work on cutting-edge data engineering initiatives, including data preparation for advanced analytics, ML, and GenAI use cases.<h3 class="jobSectionHeader">
Key Responsibilities</h3><ul><li>
Design, build, and maintain scalable, reliable, and high-performance data pipelines.</li><li>
Develop and optimize ETL/ELT processes to handle large-scale structured and unstructured data.</li><li>
Implement data models and warehouse solutions with a focus on Snowflake.</li><li>
Integrate and process data from diverse sources including SQL and NoSQL databases.</li><li>
Ensure data quality, governance, and security standards are maintained across all systems.</li><li>
Collaborate with data scientists and ML engineers to prepare data for advanced analytics and GenAI models.</li><li>
Work closely with business stakeholders to translate requirements into data engineering solutions.</li><li>
Monitor, troubleshoot, and optimize data workflows for performance and cost efficiency.</li></ul><h3 class="jobSectionHeader">
Required Skills &amp; Qualifications</h3><ul><li>
Experience: 7&ndash;10+ years of professional experience in data engineering.</li><li>
Programming: Proficiency in Python (mandatory).</li><li>
Data Engineering: Strong SQL expertise; experience with NoSQL databases; advanced skills in data modeling, ETL/ELT processes, and orchestration tools (e.g., Airflow, cloud-native services).</li><li>
Cloud: Hands-on experience with cloud data warehousing, data lakes, and related services (mandatory).</li><li>
Snowflake: Proven experience designing and managing data pipelines/warehousing in Snowflake.</li><li>
Big Data: Experience handling large volumes of structured and unstructured data.</li><li>
Desired Skills: Exposure to preparing data for ML/GenAI workloads; familiarity with data governance and data quality frameworks.</li></ul><h3 class="jobSectionHeader">
Why Join Us</h3><ul><li>
Opportunity to work onsite in Abu Dhabi on high-impact data engineering projects.</li><li>
Collaborative work environment with cross-functional teams in cloud, data, and ML domains.</li><li>
Chance to contribute to the modernization of enterprise data platforms with cutting-edge technologies.</li></ul>
xCT5UY6FsM</div>

Vtricks Technologies 

Job Title: Senior Data EngineerLocation: RemoteExperience: 4&ndash;5 YearsRole OverviewWe are looking for a Senior Data Engineer with strong hands-on expertise in building and optimizing data pipelines on the Azure cloud ecosystem. The ideal candidate should have solid experience with Azure DataBricks, Azure Data Factory, SQL, and Python to design, develop, and deliver scalable and high-performing data solutions. The role requires strong problem-solving skills, analytical thinking, and the ability to work independently in a fast-paced environment.Key ResponsibilitiesDesign, build, and maintain scalable ETL pipelines using Azure Data Factory and Azure DataBricks.Develop efficient SQL queries, stored procedures, and performance-optimized data models.Implement data workflows to ingest, transform, and load structured and unstructured data.Work closely with business stakeholders to translate requirements into technical data solutions.Ensure high performance, data integrity, and accuracy in all deliverables.Collaborate with cross-functional teams to integrate data from multiple sources.Monitor, troubleshoot, and optimize data pipelines for reliability and performance.Follow best practices for CI/CD, error handling, and logging in data workflows.Required Qualifications &amp; SkillsBachelor&rsquo;s degree in Computer Science, Engineering, or a related discipline.4&ndash;5 years of hands-on experience as a Data Engineer.Strong expertise in:Azure DataBricks &ndash; data transformations, Delta Lake, notebooks, Spark.Azure Data Factory &ndash; pipelines, linked services, datasets, triggers, CI/CD.SQL &ndash; stored procedures, triggers, performance tuning, error handling.Python &ndash; data frames, automation, integration with databases.Strong analytical and problem-solving skills.Excellent communication skills to explain technical solutions in a clear, business-friendly way.Ability to work independently in a remote, fast-paced environment.Good to Have (Preferred Skills)Azure Functions &ndash; Python-based automation and API integration.API Development (FAST API) &ndash; building and consuming APIs.Microsoft Fabric &ndash; pipelines and OneLake integration.Exposure to ML/AI &ndash; regression, classification, clustering, or time-series models.Familiarity with Generative AI and OpenAI API integrations.Why Join Us?Be part of a high-impact role working on modern Azure-based data engineering projects.Opportunity to design and implement end-to-end data solutions.Fully remote working environment with challenging and innovative projectsJob Type: Full-timePay: &#8377;500,652.22 - &#8377;1,841,823.67 per yearApplication Question(s):<ul><li>What is your notice period in days?</li></ul>Experience:<ul><li>Azure DataBricks notebook, Spark: 4 years (Required)</li><li>Azure Data Factory pipelines, linked services, CI/CD: 4 years (Required)</li></ul>Work Location: In person

ixceed

Role: Lead Data EngineerLocation: Chennai Mode: HybridType: PermanentJob Description:ob Description:We are looking for a Senior Data Engineer with strong expertise in Scala, Apache Spark, and PySpark to join our team for a high-impact project. The ideal candidate will play a leading role in developing and optimizing big data solutions on cloud-based platforms like Databricks.Key Responsibilities:<ul><li>Develop scalable data pipelines and applications using Scala, Spark, and PySpark</li><li>Collaborate with cross-functional teams to design, build, and maintain robust data solutions</li><li>Optimize data workflows for performance and scalability on Databricks</li><li>Mentor junior team members and provide technical leadership in data engineering practices</li><li>Participate in code reviews and ensure best practices are followed</li></ul>Required Skills:<ul><li>Strong hands-on experience in Scala programming (must-have)</li><li>Solid experience with Apache Spark and Databricks</li><li>Proficient in PySpark and Python</li><li>Experience building and maintaining large-scale data processing systems</li><li>Strong understanding of distributed computing principles</li><li>Ability to write clean, maintainable, and efficient code</li></ul>Nice to Have:<ul><li>Experience with cloud platforms (e.g., Azure, AWS, or GCP)</li><li>Knowledge of ELT/ETL frameworks and data orchestration tools</li><li>Familiarity with CI/CD for data pipelines</li></ul>Job Type: PermanentPay: &#8377;3,000,000.00 - &#8377;3,500,000.00 per yearExperience:<ul><li>Scala programming : 5 years (Required)</li><li>Spark: 3 years (Required)</li><li>Pyspark: 3 years (Required)</li><li>Spark (Databricks): 3 years (Required)</li><li>Total: 10 years (Required)</li></ul>Work Location: In person

<div>Job Title: Senior Data Engineer 
Location: Abu Dhabi, UAE (Onsite) 
Employment Type: Full-Time, Permanent<h3 class="jobSectionHeader">
About the Role</h3>
We are seeking a highly skilled Senior Data Engineer with 7&ndash;10+ years of experience to join our team in Abu Dhabi. The ideal candidate will have deep expertise in building and optimizing scalable data pipelines, working with large datasets, and leveraging modern cloud-based technologies. This is an onsite role offering the opportunity to work on cutting-edge data engineering initiatives, including data preparation for advanced analytics, ML, and GenAI use cases.<h3 class="jobSectionHeader">
Key Responsibilities</h3><ul><li>
Design, build, and maintain scalable, reliable, and high-performance data pipelines.</li><li>
Develop and optimize ETL/ELT processes to handle large-scale structured and unstructured data.</li><li>
Implement data models and warehouse solutions with a focus on Snowflake.</li><li>
Integrate and process data from diverse sources including SQL and NoSQL databases.</li><li>
Ensure data quality, governance, and security standards are maintained across all systems.</li><li>
Collaborate with data scientists and ML engineers to prepare data for advanced analytics and GenAI models.</li><li>
Work closely with business stakeholders to translate requirements into data engineering solutions.</li><li>
Monitor, troubleshoot, and optimize data workflows for performance and cost efficiency.</li></ul><h3 class="jobSectionHeader">
Required Skills &amp; Qualifications</h3><ul><li>
Experience: 7&ndash;10+ years of professional experience in data engineering.</li><li>
Programming: Proficiency in Python (mandatory).</li><li>
Data Engineering: Strong SQL expertise; experience with NoSQL databases; advanced skills in data modeling, ETL/ELT processes, and orchestration tools (e.g., Airflow, cloud-native services).</li><li>
Cloud: Hands-on experience with cloud data warehousing, data lakes, and related services (mandatory).</li><li>
Snowflake: Proven experience designing and managing data pipelines/warehousing in Snowflake.</li><li>
Big Data: Experience handling large volumes of structured and unstructured data.</li><li>
Desired Skills: Exposure to preparing data for ML/GenAI workloads; familiarity with data governance and data quality frameworks.</li></ul><h3 class="jobSectionHeader">
Why Join Us</h3><ul><li>
Opportunity to work onsite in Abu Dhabi on high-impact data engineering projects.</li><li>
Collaborative work environment with cross-functional teams in cloud, data, and ML domains.</li><li>
Chance to contribute to the modernization of enterprise data platforms with cutting-edge technologies.</li></ul>
YzBo50s7qA</div>

Haq BPO Solutions

Location: DHA 5, LahoreAbout the Role:Infinity Edge Technologies is hiring a Senior Data Engineer to join our growing Data Engineering team. This is a great opportunity for someone with over 3 years of experience looking to expand their skills in modern data platforms, tools, and cloud technologies.As a Senior Data Engineer, you'll play a vital role in building scalable data pipelines and helping us build a reliable data infrastructure to support analytics, reporting, and AI/ML initiatives. You&rsquo;ll work closely with engineering, analytics, and DevOps teams to deliver quality data products and enable smarter business decisions.Key Responsibilities&#9679; Build and maintain reliable, scalable ETL/ELT pipelines using tools like DBT, Airflow, or Matillion&#9679; Develop complex SQL queries for data extraction, transformation, and reporting&#9679; Work on cloud platforms like GCP, AWS, or Azure and services like BigQuery, Snowflake, or S3&#9679; Collaborate with cross-functional teams to design and implement new data models&#9679; Support data quality and data governance processes&#9679; Create and maintain technical documentation and participate in code reviews&#9679; Integrate and automate data ingestion from multiple sources (APIs, internal systems, third-party platforms)&#9679; Ensure proper access controls, security, and compliance (HIPAA, if applicable) Required Skills &amp; Qualifications&#9679; 3+ years of experience in Data Engineering, ETL/ELT processes, or Data Warehousing&#9679; Strong command over SQL, Python, and scripting for data transformation&#9679; Experience with at least one cloud platform (AWS, GCP, Azure)&#9679; Hands-on experience with modern tools like DBT, Airflow, Fivetran, Snowflake, BigQuery, etc.&#9679; Good understanding of data modeling, data governance, and data quality practices&#9679; Experience working in Agile environments and CI/CD pipelines&#9679; Comfortable working in cross-functional teams and fast-paced environments BI, Reporting &amp; Visualization: &#9679; Tableau, Power BI, Looker, Amazon QuickSight&#9679; SQL Reporting, Business KPI DashboardsData Modeling &amp; Performance:&#9679; Star Schema, Snowflake Schema, Data Vault&#9679; Dimensional Modeling, Normalization/Denormalization&#9679; Query Optimization, Indexing, Caching, Partitioning&#9679; dbt SQL TransformationsPreferred (Nice to Have)&#9679; DBT or Snowflake Certification&#9679; Knowledge of FHIR, healthcare data models, or working with regulated domains (e.g., healthcare, banking)&#9679; Experience with Docker, Kubernetes, or big data technologies like Kafka, pySpark&#9679; Understanding of data security, IAM policies, and compliance frameworksJob Type: Full-timePay: Rs300,000.00 - Rs350,000.00 per monthAbility to commute/relocate:<ul><li>Lahore: Reliably commute or planning to relocate before starting work (Preferred)</li></ul>Experience:<ul><li>4years: 3 years (Preferred)</li></ul>Work Location: In person

Search 10000+ Senior data engineer jobs near you this October. New roles added regularly across leading industries. Apply today.

10000 senior data engineer jobs NEAR_ME

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer