Qureos Mentor

Pavilion Recruitment Solutions

Pavilion Recruitment Solutions is a specialized recruitment agency focused on the Insurance and Financial Services sectors. They offer a professional and proactive approach to recruitment, ensuring that both clients and candidates receive tailored solutions that meet their specific needs. With a deep understanding of the industry and the recruitment process, Pavilion Recruitment Solutions helps clients find the best candidates quickly and efficiently, while also supporting candidates in their job searches with expert advice and insights.

<div>
 
 
 Senior Data Engineer
 
 
 
 
 Salary - &pound;60,000 - &pound;80,000
 
 
 
 
 Surrey/ Hybrid
 
 
 
 
 
 
 We&rsquo;re looking for a Senior Data Engineer to join a collaborative team of data engineers, AI engineers, data scientists, developers, analysts, and architects, helping to design and deliver innovative data and AI solutions that support business-critical products and decision-making.
 
 
 
 
 
 This is an opportunity to work on a modern cloud-based data platform, building scalable data products while contributing to the evolution of Generative AI capabilities and next-generation analytics.
 
 
 
 
 
 
 The Role
 
 
 
 As a Senior Data Engineer, you&rsquo;ll play a key role in designing, building and optimising a high-performance data platform that enables data-driven products and AI innovation. Working within cross-functional Agile teams, you&rsquo;ll collaborate with engineers, architects and product managers to solve complex data challenges and deliver scalable, reliable solutions.
 
 
 
 
 
 
 Key Responsibilities
 
 
 <ul>
 <li>
 Design, build and support enterprise-scale data products on a modern cloud data platform.
 </li>
 <li>
 Deliver robust technical solutions to complex data engineering challenges, including supporting emerging AI and Generative AI use cases.
 </li>
 <li>
 Design, develop and maintain platform components for data ingestion, orchestration, monitoring and performance optimisation.
 </li>
 <li>
 Build scalable batch and real-time data pipelines that enable seamless access to high-quality data.
 </li>
 <li>
 Integrate data from multiple sources, ensuring consistency, quality and adherence to engineering standards.
 </li>
 <li>
 Develop reusable frameworks and best practices for data pipelines across the platform.
 </li>
 <li>
 Collaborate with solution architects to design scalable data products and evaluate new technologies that enhance AI and machine learning capabilities.
 </li>
 <li>
 Work within Agile delivery teams alongside engineers, analysts, developers and product specialists.
 </li>
 </ul>
 
 
 
 
 
 About You
 
 
 
 You&rsquo;ll be an experienced Data Engineer who enjoys solving complex technical problems and building scalable data solutions.
 
 
 
 
 
 You&rsquo;ll bring:
 
 <ul>
 <li>
 Strong experience designing and developing modern cloud-based data platforms.
 </li>
 <li>
 Hands-on experience with cloud data warehouse technologies such as
 
 Databricks
 
 or
 
 Snowflake
 
 , ideally within an
 
 AWS
 
 environment but not essential.
 </li>
 <li>
 Excellent
 
 Python
 
 development skills, with strong knowledge of the Python data ecosystem including
 
 Apache Spark
 
 and
 
 Apache Airflow
 
 .
 </li>
 <li>
 Experience building and supporting both batch and streaming data integration pipelines.
 </li>
 <li>
 Strong understanding of data ingestion, transformation, cleansing and integration at scale.
 </li>
 <li>
 Experience implementing CI/CD pipelines using tools such as
 
 Git
 
 ,
 
 Jenkins
 
 , or equivalent.
 </li>
 <li>
 A collaborative approach with excellent communication and stakeholder engagement skills.
 </li>
 <li>
 A genuine passion for building high-quality, scalable data platforms.
 </li>
 </ul>
 
 
 
 
 
 What&rsquo;s on Offer
 
 
 <ul>
 <li>
 Opportunity to work on cutting-edge AI, machine learning and modern data engineering initiatives.
 </li>
 <li>
 Collaborative environment with experienced engineers, architects and data scientists.
 </li>
 <li>
 Modern cloud technology stack and a strong engineering culture.
 </li>
 <li>
 Exposure to innovative technologies and the freedom to evaluate and introduce new tools.
 </li>
 <li>
 Competitive salary, comprehensive benefits package and flexible hybrid working.
 </li>
 <li>
 Excellent opportunities for technical development and career progression.
 </li>
 </ul>
 
 
 
 
 If you&rsquo;re excited by the opportunity to build scalable data platforms that underpin advanced analytics and AI solutions, please get in touch.
 
 
 
 
</div>

Senior Data Engineer

Join Pavilion Recruitment Solutions and explore 1   exciting career opportunities. They're hiring for various roles with options for remote or on-site work. Apply today and become part of their innovative team.

Pavilion Recruitment Solutions

About Company

Senior Data Engineer