databricks engineer

Version 1

<div><b>Company Description</b><p><br>
Version 1 has celebrated over 28 years in Technology Services and continues to be trusted by global brands to deliver solutions that drive customer success. Version 1 has several strategic technology partners including Microsoft, AWS, Oracle, Red Hat, OutSystems and Snowflake. We&rsquo;re also an award-winning employer reflecting how employees are at the heart of Version 1.</p><p>
We&rsquo;ve been awarded: Innovation Partner of the Year Winner 2023 Oracle EMEA Partner Awards, Global Microsoft Modernising Applications Partner of the Year Award 2023, AWS Collaboration Partner of the Year - EMEA 2023 and Best Workplaces for Women by Great Place To Work in UK and Ireland 2023.</p><p>
As a consultancy and service provider, Version 1 is a digital-first environment and we do things differently. We&rsquo;re focused on our core values; using these we&rsquo;ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of the fastest-growing consultancies globally.</p><b><br>
Job Description</b><p><br>
We are seeking a talented and experienced Databricks Engineer to join our innovative team in Bengaluru, India. In this role, you will be responsible for designing, implementing, and optimising data pipelines and analytics solutions using the Databricks platform. You will collaborate closely with cross-functional teams to deliver high-quality, scalable data solutions that drive business insights and decision-making.</p><ul><li>
Develop and optimise ETL processes using Databricks and Apache Spark</li><li>
Design and implement efficient data models and schemas for optimal data storage and retrieval</li><li>
Collaborate with data scientists and analysts to build and deploy machine learning models</li><li>
Ensure data quality, consistency, and reliability across all data pipelines</li><li>
Optimise query performance and troubleshoot data processing issues</li><li>
Implement robust data security and access control measures</li><li>
Stay abreast of the latest Databricks features and best practices</li><li>
Participate in code reviews and contribute to the team's knowledge base</li><li>
Mentor junior team members and share expertise in big data technologies</li><li>
Develop and maintain documentation for data processes and workflows</li><li>
Collaborate with stakeholders to understand business requirements and translate them into technical solutions</li></ul><br>
<b>
Qualifications</b><br>
<ul><li>
Bachelor's degree in Computer Science, Data Science, or a related field</li><li>
6+ years of experience in data engineering or a related field</li><li>
Strong proficiency in Databricks platform and Apache Spark</li><li>
Excellent SQL skills and experience with Python or Scala</li><li>
Proven experience in designing and implementing ETL processes and data pipelines</li><li>
Solid understanding of big data technologies and distributed computing concepts</li><li>
Experience working with cloud platforms such as AWS, Azure, or GCP</li><li>
Familiarity with version control systems, preferably Git</li><li>
Strong analytical and problem-solving skills with keen attention to detail</li><li>
Excellent communication and collaboration skills</li><li>
Experience with data warehousing and analytics concepts</li><li>
Knowledge of data governance and compliance standards</li><li>
Experience with real-time data processing and streaming technologies</li><li>
Ability to work in a fast-paced, dynamic environment and manage multiple priorities</li><li>
Databricks certifications are desirable</li></ul><br>
<b>
Additional Information</b><p><br>
At Version 1, we believe in providing our employees with a comprehensive benefits package that prioritises their well-being, professional growth, and financial stability.</p><p>
One of our standout advantages is the ability to work with a hybrid schedule along with business travel, allowing our employees to strike a balance between work and life. We also offer a range of tech-related benefits, including an innovative Tech Scheme to help keep our team members up-to-date with the latest technology.</p><p>
We prioritise the health and safety of our employees, providing private medical and life insurance coverage, as well as free eye tests and contributions towards glasses. Our team members can also stay ahead of the curve with incentivized certifications and accreditations, including AWS, Microsoft, Oracle, and Red Hat.</p><p>
Our employee-designed Profit Share scheme divides a portion of our company's profits each quarter amongst employees. We are dedicated to helping our employees reach their full potential, offering Pathways Career Development Quarterly, a programme designed to support professional growth.</p></div>

Databricks Engineer

Relevance Labs

<div><p>As an Azure Databricks Engineer, you will be responsible for designing, developing, and maintaining data pipelines and solutions on the Azure Databricks platform. You will work closely with data scientists, data engineers, and business stakeholders to understand requirements, implement solutions, and ensure the reliability and performance of data infrastructure. Responsibilities:</p>
<ul><li>Design, develop, and maintain data pipelines using Azure Databricks.</li>
<li>Implement data ingestion, transformation, and loading processes.</li>
<li>Optimize Databricks clusters for performance and cost efficiency.</li>
<li>Collaborate with data scientists and engineers to build and deploy machine learning models.</li>
<li>Monitor and troubleshoot data pipelines and infrastructure.</li>
<li>Implement data security and governance best practices.</li>
<li>Automate data pipeline deployments and infrastructure provisioning.</li>
<li>Stay up-to-date with the latest Azure Databricks features and best practices.</li></ul></div>

Azure Databricks Engineer

Neurealm

<div><div><div><div><div><div><p>Chennai, Tamil Nadu, India</p></div></div></div><div><p><br>
</p><p>
</p></div></div><div><div><div><div>Department</div><div>
Data Science/Big Data Mining</div></div><div><div>
Job posted on</div><div>
Oct 22, 2025</div></div><div><div>
Employment type</div><div>
Full Time Employee</div></div></div></div></div><div></div><div><div><div><div><div>
A Data Engineer Job Description Samples &amp; Tips in 2025A data engineer designs, builds, and maintains the data infrastructure, such as databases and data pipelines, that collect, store, and process raw data into usable information for data scientists and business analysts.</div></div></div></div></div></div>

Sr. Databricks Engineer

Astellas

<div><p>As part of the Astellas commitment to delivering value for our patients, our organisation is currently undergoing transformation to achieve this critical goal. This is an opportunity to work on digital transformation and make a real impact within a company dedicated to improving lives.
</p><p>DigitalX our new information technology function is spearheading this value driven transformation across Astellas. We are looking for people who excel in embracing change, manage technical challenges and have exceptional communication skills.
</p><p>We are seeking committed and talented DataBricks Developers with 2- 4 years progressive experience to join our new InformationX team- which lies at the heart of DigitalX.
</p><p>The ideal candidate will have a minimum of 2 years of professional experience leveraging the Databricks platform to deliver data engineering, machine learning (ML), and business intelligence outputs. You will be responsible for building and maintaining robust data pipelines, developing scalable ML models, and generating actionable insights from large datasets. This role requires a strong understanding of big data technologies, data architecture, and proficiency in languages such as Python and SQL.
</p><p>As a member of our team within InformationX, you will be responsible for ensuring our data driven systems are operational, scalable and continue to contain the right data to drive business value.<br>
</p><p></p><p>Responsibilities:
</p><p>Your responsibilities will include executing complex data projects, ensuring smooth data flows between systems, and maintaining the efficiency and reliability of data platforms. This is a fantastic global opportunity to use your proven agile delivery skills across a diverse range of initiatives, utilise your development skills, and contribute to the continuous improvement/delivery of critical IT (Information Technology) solutions.<br>
</p><p></p><ul><li>Data Engineering: Design, develop, and maintain efficient and reliable ETL/ELT pipelines using Databricks notebooks and Delta Lake.
</li></ul><ul><li>Machine Learning: Collaborate with data scientists to deploy and manage scalable ML models, ensuring they are integrated into production workflows.
</li></ul><ul><li>Insight Delivery: Create and optimize notebooks and queries to provide data-driven insights and reports to business stakeholders.
</li></ul><ul><li>Platform Management: Manage Databricks clusters and jobs, ensuring optimal performance, cost-efficiency, and security.
</li></ul><ul><li>Collaboration: Work closely with data scientists, analysts, and business teams to understand requirements and deliver end-to-end data solutions.
</li></ul><p>You will also be contributing to the following areas:
</p><ul><li>End-to-End Data Solutions:
<ul><li>Design end-to-end scalable data streams, storage, data serving systems, and analytical workflows using Databricks.
</li><li>Define overall architecture, capabilities, platforms, tools, and governing processes.
</li></ul></li><li>Data Pipeline Development:
<ul><li>Build data pipelines to extract, transform, and load data from various sources.
</li><li>Set up metadata and master data structures to support transformation pipelines in Databricks.
</li></ul></li><li>Data Warehousing and Data Lakes:
<ul><li>Create data warehouses and data lakes for efficient data storage and management.
</li><li>Develop and deploy data processing and analytics tools.
</li></ul></li><li>Collaboration with DataX and other key stakeholder value teams:
</li><li>Collaborate with data modelers to create advanced data structures and models within the Databricks environment.
</li><li>Develop and maintain Python scripts for data processing, transformation, and analysis.
</li><li>Utilize Azure and AWS cloud services (e.g., Azure Data Lake, AWS S3, Redshift) for data storage and processing.
</li><li>Apply expertise in Databricks to enhance data architecture, performance, and reliability. Lead relevant data governance initiatives and ensure compliance with industry standards.
<ul><li>Work closely with data scientists to develop and deploy data-driven solutions.
</li><li>Provide technical direction to Data Engineers and perform code reviews.
</li></ul></li><li>Continuous Learning:
<ul><li>Stay up to date on the latest data technologies, trends, and best practices.
</li><li>Participate in smaller focused mission teams to deliver value driven solutions aligned to our global and bold move priority initiatives and beyond.
</li></ul></li><li>Collaborate with cross functional teams and practises across the organisation including Commercial, Manufacturing, Medical, DataX, GrowthX and support other X (transformation) Hubs and Practices as appropriate, to understand user needs and translate them into technical solutions.
</li><li>Provide Level 3 and 4 Technical Support to internal users troubleshooting complex issues and ensuring system uptime as soon as possible.
</li><li>Champion continuous improvement initiatives identifying opportunities to optimise performance security and maintainability of existing data and platform architecture and other technology investments.
</li><li>Participate in the continuous delivery pipeline Adhering to DevOps best practises for version control automation and deployment. Ensuring effective management of the FoundationX backlog.
</li><li>Leverage your knowledge of Machine Learning (ML) and data engineering principles to integrate with existing data pipelines and explore new possibilities for data utilization.
</li><li>Stay up to date on the latest trends and technologies in full-stack-development, data engineering and cloud platforms.</li></ul></div>
<br><div><p>Technical Skills:
</p><ul><li>Proficiency in PySpark/ Python or Scala for data manipulation, scripting, and analytics
</li><li>Strong understanding of distributed computing principles
</li><li>Experience using ETL tools like Talend/Talend Cloud and DataStage.
</li><li>Knowledge and experience using Azure DevOps.
</li><li>Experience with cloud services such as Azure Data Lake, AWS S3, and Redshift
</li><li>Experience in working with MPP Databases like AWS Redshift.
</li>Experience in integrating data from multiple sources like relational databases, Salesforce, SAP, and API calls.<br>
<li>
</li></ul><p></p><p>Required Qualifications:
</p><ul><li>Bachelor's or Master's degree in Computer Science, Engineering, or related field.
</li><li>3 years+ of experience as a Data Engineer or DataBricks Developer.
</li><li>Proficiency in Python for data manipulation, scripting, and analytics.
</li>Strong understanding of data modelling concepts and practices.<br>
<li>
</li></ul><p></p><p>Any relevant cloud-based DataBricks, AWS or Azure certifications for example:
</p><ul><li>Databricks Data Engineer
</li><li>AWS Certified Data Analytics Speciality &ndash; Professional / Associate (will be considered with relevant experience)
</li><li>Microsoft Certified Azure Data Engineer Associate
</li><li>Microsoft Certified Azure Database Administrator
</li><li>Microsoft Certified Azure Developer
</li><li>Experience using ETL tools like Talend / Talend Cloud and DataStage (Essential)
</li><li>Knowledge and experience using Azure DevOps (Essential)
</li><li>Knowledge and experience of working with SalesForce / SAP (Desirable)
</li><li>Experience in working with MPP Databases like AWS Redshift
</li><li>Experience of delivering architectural solutions effectively within Lifesciences or Pharma Domains.
</li></ul><p>Preferred Qualifications:
</p><ul><li>Experience analysing and building star schema data warehouses
</li><li>Experiencing writing SQL and creating stored procedures is essential
<br>
Data Analysis and Automation Skills: Proficient in identifying, standardizing, and automating critical reporting metrics and modelling tools.
</li><li>Analytical Thinking: Demonstrated ability to lead ad hoc analyses, identify performance gaps, and foster a culture of continuous improvement.
</li><li>Experience in integrating data from multiple Data sources like relational Databases, Salesforce, SAP and API calls.
</li><li>Agile Champion: Adherence to DevOps principles and a proven track record with CI/CD pipelines for continuous delivery.
</li><li>Understand and Interpret business requirements and can term them into technical requirements.
</li><li>Create and maintain technical documentation as part of CI/CD principles
</li></ul><p>&quot;Beware of recruitment scams impersonating Astellas recruiters or representatives. Authentic communication will only originate from an official Astellas LinkedIn profile or a verified company email address. If you encounter a fake profile or anything suspicious, report it promptly to LinkedIn's support team through LinkedIn Help&quot;</p></div>

Databricks Data Engineer

<div><p><b>Line of Service
</b></p>Advisory
<p></p><p><b>Industry/Sector
</b></p>Technology
<p></p><p><b>Specialism
</b></p>Advisory - Other
<p></p><p><b>Management Level
</b></p>Senior Associate
<p></p><p><b>Job Description &amp; Summary
</b></p>As a Senior Associate in the Data Engineering team, you will play a key role in designing, building, and optimizing modern data platforms and pipelines on Azure and Databricks. You will work within cross-functional teams to deliver scalable, secure, and high-performing data solutions that enable advanced analytics, AI, and business insights for enterprise clients.
<br>
This role requires a strong understanding of cloud data architecture, hands-on experience with Azure data services (including Microsoft Fabric), and deep practical knowledge of Databricks for batch and data engineering.
<p></p><p><b>Key Responsibilities
</b></p><ul><li>Design, develop, and maintain end-to-end data pipelines across structured, semi-structured, and unstructured data sources.
</li><li>Implement data ingestion, transformation, and orchestration frameworks leveraging Azure Data Factory, Synapse, and/or Microsoft Fabric Data Pipelines.
</li><li>Develop and optimize ETL/ELT processes using Databricks (PySpark, SQL, Delta Lake) to ensure high performance and scalability.
</li><li>Implement and enforce data quality, lineage, and governance practices.
</li><li>Work closely with solution architects to design modern data architectures and ensure compliance with security and privacy standards.
</li>Participate in client workshops and technical discussions to translate business needs into technical designs.<br>
<li>
</li></ul><p><br>
<b>Required Skills &amp; Experience
</b></p><ul><li>3&ndash;6 years of experience in data engineering, preferably in a consulting or enterprise environment.
</li><li>Strong hands-on experience with:
<ul><li>Azure Data Platform: Data Factory, Synapse Analytics, Azure Data Lake Storage, Microsoft Fabric, Event Hub/IoT Hub, and Azure Functions.
</li><li>Databricks: PySpark, Spark SQL, Delta Lake, Unity Catalog, and Databricks Workflows.
</li></ul></li><li>Proficiency in Python and SQL for large-scale data processing and transformation.
</li><li>Solid understanding of data modeling, medallion architecture, and lakehouse principles.
</li><li>Familiarity with CI/CD pipelines, DevOps, and version control (e.g., Git, Azure DevOps).
</li><li>Knowledge of data governance, lineage, and observability tools.
</li><li>Experience with performance optimization, cost control, and best practices in cloud environments.
</li></ul><p></p><p><b>Education </b><i>(if blank, degree and/or field of study not specified)
</i></p>Degrees/Field of Study required:
<p></p>Degrees/Field of Study preferred:
<p></p><p><b>Certifications </b><i>(if blank, certifications not specified)
</i></p><p></p><p><b>Required Skills
</b></p><p></p><p><b>Optional Skills
</b></p>Accepting Feedback, Accepting Feedback, Active Listening, Agile Scalability, Amazon Web Services (AWS), Analytical Thinking, Apache Airflow, Apache Hadoop, Azure Data Factory, Communication, Creativity, Data Anonymization, Data Architecture, Database Administration, Database Management System (DBMS), Database Optimization, Database Security Best Practices, Databricks Unified Data Analytics Platform, Data Engineering, Data Engineering Platforms, Data Infrastructure, Data Integration, Data Lake, Data Modeling, Data Pipeline {+ 27 more}
<p></p><p><b>Desired Languages </b><i>(If blank, desired languages not specified)
</i></p><p></p><p><b>Travel Requirements
</b></p>Not Specified
<p></p><p><b>Available for Work Visa Sponsorship?
</b></p>No
<p></p><p><b>Government Clearance Required?
</b></p>No
<p></p><p><b>Job Posting End Date</b></p></div><p></p>

ETIC, Azure and Databricks Data Engineer, Senior Associate

Infosys

<div><h2 class="jobSectionHeader"><b>Job Description:</b></h2><br>
<ul>
<li>Looking for a skilled Data Engineer to join our team</li>
<li>The ideal candidate should have experience in Databricks SQL PySpark Spark Python and Azure Data Factory ADF</li>
<li>The candidate should be able to design develop and maintain data pipelines and data streams</li>
<li>The candidate should also be able to move transform data across layers Bronze Silver Gold using ADF Python and PySpark</li>
<li>Responsibilities</li>
<li>Design and build modern data pipelines and data streams</li>
<li>Move Transform data across layers Bronze Silver Gold using ADF Python and PySpark</li>
<li>Develop and maintain data pipelines and data streams</li>
<li>Work with stakeholders to understand their data needs and provide solutions</li>
<li>Collaborate with other teams to ensure data quality and consistency</li>
<li>Develop and maintain data models and data dictionaries</li>
<li>Develop and maintain ETL processes</li>
<li>Develop and maintain data quality checks</li>
<li>Develop and maintain data governance policies and procedures</li>
<li>Develop and maintain data security policies and procedures</li>
<li>Provide technical guidance and mentorship to junior data engineers</li></ul><br>
<h2 class="jobSectionHeader"><b>
Key Responsibilities:</b></h2><br>
<ul>
<li>Requirements</li>
<li>Experience in Databricks SQL PySpark Spark Python and Azure Data Factory ADF</li>
<li>Experience in designing developing and maintaining data pipelines and data streams</li>
<li>Experience in moving transforming data across layers Bronze Silver Gold using ADF Python and PySpark</li>
<li>Experience in working with stakeholders to understand their data needs and provide solutions</li>
<li>Experience in collaborating with other teams to ensure data quality and consistency</li>
<li>Experience in developing and maintaining data models and data dictionaries</li>
<li>Experience in developing and maintaining ETL processes</li>
<li>Experience in developing and maintaining data quality checks</li>
<li>Experience in developing and maintaining data governance policies and procedures</li>
<li>Experience in developing and maintaining data security policies and procedures</li></ul><br>
<h2 class="jobSectionHeader"><b>
Technical Requirements:</b></h2><br>
<ul>
<li>Primary skills Technology Cloud Platform Azure Development Solution Architecting</li></ul><br>
<h2 class="jobSectionHeader"><b>
Additional Responsibilities:</b></h2><br>
<ul>
<li>Knowledge of more than one technology</li>
<li>Basics of Architecture and Design fundamentals</li>
<li>Knowledge of Testing tools</li>
<li>Knowledge of agile methodologies</li>
<li>Understanding of Project life cycle activities on development and maintenance projects</li>
<li>Understanding of one or more Estimation methodologies Knowledge of Quality processes</li>
<li>Basics of business domain to understand the business requirements</li>
<li>Analytical abilities Strong Technical Skills Good communication skills</li>
<li>Good understanding of the technology and domain</li>
<li>Ability to demonstrate a sound understanding of software quality assurance principles SOLID design principles and modelling methods</li>
<li>Awareness of latest technologies and trends</li>
<li>Excellent problem solving analytical and debugging skills</li></ul></div>

Azure Databricks Data Engineer/Developer

Zillion Technologies

<p><b>Senior Data Engineer &ndash; Databricks</b></p><p><b>Location: Hyderabad/Chennai </b></p><p><b>Work Schedule: </b>Timings 2:30 PM to 11:30 PM</p><p><b>Role Overview:</b></p><p>We are seeking a highly skilled Senior Data Engineer with deep expertise in Databricks to design, build, and optimize scalable data pipelines and architectures. You will collaborate with cross-functional teams including data scientists, analysts, and platform engineers to deliver high-quality, reliable, and secure data solutions.</p><p><b>Key Responsibilities:</b></p><ul><li>Design, develop, and maintain robust batch and streaming data pipelines using Databricks, Apache Spark, Delta Lake, and PySpark.</li><li>Build and optimize ETL/ELT workflows to transform and integrate data from diverse sources.</li><li>Implement Delta Live Tables (DLT) and Databricks Workflows for pipeline orchestration and automation.</li><li>Ensure data quality, observability, and monitoring across all pipelines.</li><li>Collaborate with cloud platform teams (AWS/Azure) to ensure proper setup of storage, networking, and security.</li><li>Work within Agile teams, participating in sprint planning, code reviews, and deployments.</li><li>Document pipeline processes, technical specifications, and architectural decisions.</li><li>Stay current with emerging technologies and best practices in data engineering and cloud-native solutions.</li></ul><p><b>Required Qualifications:</b></p><ul><li>Bachelor&rsquo;s or Master&rsquo;s degree in Computer Science, Engineering, or related field.</li><li>Around 5 years of experience in data engineering, with 3+ years hands-on in Databricks.</li><li>Strong proficiency in PySpark, SQL, and Apache Spark.</li><li>Experience with cloud platforms (Azure or AWS) and big data technologies (e.g., Kafka, Hadoop).</li><li>Solid understanding of data warehousing, data modeling, and ETL processes.</li><li>Familiarity with data governance, security, and compliance frameworks.</li></ul><p><b>Preferred Skills:</b></p><ul><li>Experience with Delta Live Tables (DLT) and Unity Catalog.</li><li>Knowledge of CI/CD pipelines, Git, and DevOps practices.</li><li>Certifications in Databricks, AWS, or Azure are an added advantage.</li></ul><p><b>Soft Skills:</b></p><ul><li>Excellent communication and collaboration skills.</li><li>Strong problem-solving and analytical mindset.</li><li>Ability to work independently and lead initiatives.</li></ul><p>Job Types: Full-time, Permanent</p><p>Work Location: In person</p>

Senior Data Engineer – Databricks

Search 7948+ Databricks engineer jobs near you this October. New roles added regularly across leading industries. Apply today.