cloud data engineer

Raytheon

<div>Date Posted:
2026-03-17
Country:
United Kingdom
Location:
Manchester, Lancashire
Position Role Type:
Onsite
Raytheon UK have a full time, permanent opportunity for a Data Engineer to join our team on our Manchester, Gloucester or London sites working onsite.
Our Data Engineering role will be responsible for building and maintaining data processing pipelines and also the transformation and optimisation of data for analytical use. As Data Engineer, you'll be part of our experienced software dev function, working in a cross-functional Agile team.
We have opportunities for Data Engineers at every level within a team, so upon reviewing your application we will discuss the great opportunities for development or challenges we offer based off your professional profile.
Due to the interesting work we do and the sector this team is working in, we require all candidates to hold current eDV clearance.
Responsibilities<ul><li>
Build data pipelines that clean, transform, and aggregate data from disparate sources</li><li>
Collaborate with stakeholders and other engineers</li><li>
Contribute to the completion of milestones associated with your project</li><li>
Contribute to continuous improvement within your team</li><li>
Collaborate with your peers on technical direction within your team</li></ul>
Required Skills and Experience<ul><li>
Strong analytic skills related to working with unstructured datasets</li><li>
Python (PySpark, Pandas, PyArrow)</li><li>
Distributed data processing (Apache Spark)</li><li>
Data ETL (Apache Airflow, AWS Step Functions, Apache NiFi)</li><li>
Cloud services (AWS, Azure or GCP)</li><li>
Messaging / Streaming (Kafka, AWS SQS, Other Cloud Queuing Native services)</li><li>
SQL and NoSQL databases and storage (HDFS, Iceberg, Elastic, S3, Data Lake)</li><li>
Containerisation and orchestration (Docker / Kubernetes / Openshift)</li><li>
Testing frameworks and best practices</li></ul>
We appreciate you may not be an expert in every area above - we can support with training and development in some areas! Please do make an application and we will identify where we can best support your growth specific to your application.<div>
Benefits &amp; Work Culture
Benefits:<ul><li>
Contributory Pension Scheme (up to 10.5% company contribution)</li><li>
6 times salary &lsquo;Life Assurance&rsquo; with pension</li><li>
25 days holiday (increasing with service) + statutory public holidays, plus opportunity to buy and sell up to 5 days</li><li>
Company bonus scheme (discretionary)</li><li>
Flexible Benefits scheme with extensive salary sacrifice schemes, including Health Cashplan, Dental, and Cycle to Work amongst others</li><li>
Enhanced sick pay</li><li>
Enhanced family friendly policies including enhanced maternity, paternity &amp; shared parental leave</li></ul>
Work Culture:<ul><li>
37hr working week</li><li>
Early 1.30pm finish Friday, start your weekend early!</li><li>
Up to 5 paid days volunteering each year.</li><li>
Flexible working culture focused on output, with more formal flexible working arrangements on request (assessed subject to role) - please highlight any requests to the Talent Acquisition team.</li></ul></div> 
About us
In this area of Raytheon UK we provide DevSecOps at scale, Artificial Intelligence, Machine Learning, cyber and geospatial intelligence capabilities to support the defence, intelligence and cyber sectors. Collaborating with customers and suppliers to deliver secure, mission critical systems using the latest technologies and innovations.
At Raytheon UK, we take immense pride in being a leader in defence and aerospace technology. As an employer, we are dedicated to fuelling innovation, nurturing talent, and fostering a culture of excellence. 
 
Joining our team means being part of an organisation that shapes the future of national security whilst investing in your growth and personal development. We provide a collaborative environment, abundant opportunities for professional development, and a profound sense of purpose in what we do. Together, we are not just advancing technology; we're building a community committed to safeguarding a safer and more connected world.
RTX 
Raytheon UK is a landed company and part of the wider RTX organisation. Headquartered in Arlington, Virginia, USA, but with over 180,000 employees globally across every continent, RTX provides advanced systems and services for commercial, military and government customers worldwide and comprises three industry-leading businesses &ndash; Collins Aerospace Systems, Pratt &amp; Whitney, and Raytheon. 
Supporting over 35,000 jobs across 13 UK sites, RTX is helping to drive prosperity. Each year our work contributes over &pound;2.7bn to the UK economy and offers a wealth of opportunities to 4,000 suppliers across England, Scotland, Wales and Northern Ireland. We&rsquo;re investing in all corners of the country, supporting 29,040 jobs in England, 3,040 in Northern Ireland, 1,900 in Scotland and 1,600 in Wales.
#LI-AS3
RTX adheres to the principles of equal employment. All qualified applications will be given careful consideration without regard to ethnicity, color, religion, gender, sexual orientation or identity, national origin, age, disability, protected veteran status or any other characteristic protected by law.
Privacy Policy and Terms:</div>

Data Engineer

bcn group

<div>Job title: Azure DevOps Engineer
Location: Hybrid or Remote working available
Hours: Monday to Friday, 37.5 hours per week
Salary: Competitive + benefits 
About BCN:
At BCN we unite people and technology to enable organisations to fly. 
We believe people and organisations can achieve anything using technology to it&rsquo;s full potential. Our role is to help them understand what is possible, implement in the right way and utilise their technology to achieve their ambitions. Which is why we put people front and centre &ndash; building client relationships for life and fostering a culture where our people thrive. 
We are a leading managed IT services provider and technology consultant, specialising in delivering transformative technology solutions with industry-leading client experience across business, public sector and not for profit organisations. From cloud computing, cybersecurity, and data management to power app development, we are dedicated to pioneering technology with Microsoft innovation. 
Guided by our 3 values of building relationships, customer success and passion and dedication, we are on a mission to make BCN the most trusted tech partner in the UK today. The kind of company clients want to work with, and people want to work for. 
We are delighted you are on this journey with us! 
Focus of the role:
As an Azure DevOps Engineer, you will be responsible for working directly with our customers in various sectors to deliver public cloud transformation projects in Azure using infrastructure as code to support the deployment and configuration of various resource types in the Azure technology stack. 
Responsibilities:<ul><li>
Deploying and configuring Azure resources using infrastructure as code (IaC).</li><li>
Building and configuring continuous integration and continuous deployment (CI/CD) pipelines to deploy resources to customer environments.</li><li>
Take technical ownership of project delivery for various customer projects.</li><li>
Align deployment tasks and architecture with best practice alignments in both the Azure Cloud Adoption and Well Architected frameworks.</li><li>
Optimise and speed up future deployments by creating templates aligned with Enterprise Scale Landing Zones and secured, well-governed configurations and resource deployments.</li><li>
Align deployments with best practice security standards and guidelines such as National Institute of Standards (NIST) Cybersecurity Framework, ISO27001, Centre for Internet Security (CIS) and zero-trust principles.</li></ul> 
Person, Skills &amp; Experience:<ul><li>
Microsoft Azure experience would be preferred but other public cloud platform experience such as AWS, GCP or Oracle would be accepted.</li><li>
Excellent skills in infrastructure as code (IaC) provisioning using continuous configuration automation tools such as Terraform, Puppet, Chef, Ansible or equivalent.</li><li>
Ideally experience of Bicep.</li><li>
Excellent skills working with continuous integration and continuous deployment (CI/CD) pipeline tools such as GitHub Actions and Azure DevOps.</li><li>
Good awareness of Microsoft&rsquo;s Cloud Adoption and Well Architected Frameworks</li><li>
Experience of working in a DevOps focused role or experience of other project delivery using Infrastructure as Code (IaC)</li><li>
Microsoft Certified: Azure Administrator Associate (AZ-104) or equivalent</li><li>
Ideally Microsoft Certified: DevOps Engineer Expert</li><li>
Good knowledge of networking principles ideally in public cloud</li><li>
Good knowledge of firewalls, whether PaaS or 3rd party network virtual appliances</li><li>
Experience of supporting Windows Server environments (Windows Server 2016, 2019, 2022)</li></ul> 
Why BCN?<ul><li>
The opportunity to shape your own future with industry leading training and development, with access to our BCN Academy.</li><li>
Competitive salary with the ability to progress.</li><li>
23-days holiday allowance, increasing with length of service, plus bank holidays, an extra day off on your birthday and the option to buy more!</li><li>
Company pension scheme.</li><li>
2 paid leave days per year to volunteer and support your local community &ndash; if it matters to you it matters to us.</li><li>
Health cash plan with free access to a confidential Employee Assistance Programme (EAP) supporting bereavement, financial, health and wellbeing, and much more</li><li>
Life assurance</li><li>
Cycle to work scheme, electric vehicle scheme, home and tech scheme, and retail discounts.</li><li>
Balancing work, life, and fitness can be challenging, so we offer a free on-site gym at our Manchester and Leeds locations to make it easier to stay active.</li><li>
Long service recognition to celebrate all the milestones</li><li>
Beer (or soft drinks), Pizza at the end of month, dress down every day, social events such as Summer BBQ, Christmas party and lots more!</li></ul></div>

Azure DevOps Engineer

<div>Date Posted:
2026-03-18
Country:
United Kingdom
Location:
Manchester, Lancashire
Position Role Type:
Onsite
Raytheon UK have a full time, perm opportunity for a Senior Data Engineer to join our specialist teams in Manchester, Gloucester or London working fully onsite.
As Senior Data Engineer, you'll be part of our experienced software dev function, working in a cross-functional Agile team. The Data Engineering role will be responsible for building and maintaining data processing pipelines and also the transformation and optimisation of data for analytical use.
We have opportunities for Data Engineers at every level within a team, so your Recruiter will discuss the great opportunities for development or challenges we offer based off your professional profile.
Due to the interesting work we do and the sector this team is working in, we require all candidates to currently hold eDV clearance.
In this area of Raytheon UK we provide DevSecOps at scale, Artificial Intelligence, Machine Learning, cyber and geospatial intelligence capabilities to support the defence, intelligence and cyber sectors. Collaborating with customers and suppliers to deliver secure, mission critical systems using the latest technologies and innovations.
Responsibilities<ul><li>
Build data pipelines that clean, transform, and aggregate data from disparate sources</li><li>
Collaborate with stakeholders and other engineers</li><li>
Contribute to the completion of milestones associated with your project</li><li>
Contribute to continuous improvement within your team</li><li>
Collaborate with your peers on technical direction within your team</li></ul>
Required Experience:<ul><li>
Strong analytic skills related to working with unstructured datasets</li><li>
Python (PySpark, Pandas, PyArrow)</li><li>
Distributed data processing (Apache Spark)</li><li>
Data ETL (Apache Airflow, AWS Step Functions, Apache NiFi)</li><li>
Cloud services (AWS, Azure or GCP)</li><li>
Messaging / Streaming (Kafka, AWS SQS, Other Cloud Queuing Native services)</li><li>
SQL and NoSQL</li><li>
Storage (HDFS, Iceberg, Elastic, S3, Data Lake)</li><li>
Containerisation and orchestration (Docker / Kubernetes / Openshift)</li><li>
Testing frameworks and best practices</li><li>
Use of Code repositories, familiarity with branching strategies, pull requests and merge processes</li></ul>
We appreciate you may not be an expert in every area above - we can support with training and development in some areas! Please do make an application and we will identify where we can best support your growth specific to your application.<div>
Benefits &amp; Work Culture
Benefits:<ul><li>
Contributory Pension Scheme (up to 10.5% company contribution)</li><li>
6 times salary &lsquo;Life Assurance&rsquo; with pension</li><li>
25 days holiday (increasing with service) + statutory public holidays, plus opportunity to buy and sell up to 5 days</li><li>
Company bonus scheme (discretionary)</li><li>
Flexible Benefits scheme with extensive salary sacrifice schemes, including Health Cashplan, Dental, and Cycle to Work amongst others</li><li>
Enhanced sick pay</li><li>
Enhanced family friendly policies including enhanced maternity, paternity &amp; shared parental leave</li></ul>
Work Culture:<ul><li>
37hr working week</li><li>
Early 1.30pm finish Friday, start your weekend early!</li><li>
Up to 5 paid days volunteering each year.</li><li>
Flexible working culture focused on output, with more formal flexible working arrangements on request (assessed subject to role) - please highlight any requests to the Talent Acquisition team.</li></ul></div> 
About us
At Raytheon UK, we take immense pride in being a leader in defence and aerospace technology. As an employer, we are dedicated to fuelling innovation, nurturing talent, and fostering a culture of excellence. 
 
Joining our team means being part of an organisation that shapes the future of national security whilst investing in your growth and personal development. We provide a collaborative environment, abundant opportunities for professional development, and a profound sense of purpose in what we do. Together, we are not just advancing technology; we're building a community committed to safeguarding a safer and more connected world.
RTX 
Raytheon UK is a landed company and part of the wider RTX organisation. Headquartered in Arlington, Virginia, USA, but with over 180,000 employees globally across every continent, RTX provides advanced systems and services for commercial, military and government customers worldwide and comprises three industry-leading businesses &ndash; Collins Aerospace Systems, Pratt &amp; Whitney, and Raytheon. 
Supporting over 35,000 jobs across 13 UK sites, RTX is helping to drive prosperity. Each year our work contributes over &pound;2.7bn to the UK economy and offers a wealth of opportunities to 4,000 suppliers across England, Scotland, Wales and Northern Ireland. We&rsquo;re investing in all corners of the country, supporting 29,040 jobs in England, 3,040 in Northern Ireland, 1,900 in Scotland and 1,600 in Wales.
#LI-AS3
RTX adheres to the principles of equal employment. All qualified applications will be given careful consideration without regard to ethnicity, color, religion, gender, sexual orientation or identity, national origin, age, disability, protected veteran status or any other characteristic protected by law.
Privacy Policy and Terms:</div>

Senior Data Engineer

Betfred

<div>About Us 
 
Our mission is to dominate the betting and gaming industry on a global scale and we need the very best Tech talent to help us achieve this.
With our proprietary platform powering everything we do, it's an exciting time to join us. We're pioneering new products and driving more advanced, creative technologies. The result? Unrivalled experiences for millions of customers worldwide.
Betfred's Technology department is driven by innovation, and you'll be at the heart of unlocking our platform's potential. So, if you want to help shape the future of betting and gaming, it's time to join us.
Job Purpose
We&rsquo;re looking for a Platform Engineer to help build, operate, and improve the platforms that underpin our engineering teams. This role is ideal for someone who enjoys working across infrastructure, automation, and delivery tooling, and who wants to deepen their experience in modern platform and DevOps practices. 
 
You&rsquo;ll work closely with other platform engineers and product teams to improve how software is built, deployed, and operated, reducing friction, increasing reliability, and enabling teams to move faster with confidence. 
Our core application platform is built on .NET, with services connected using WebAPI, WCF, and RabbitMQ. We store and process large volumes of data using MySQL and MongoDB. 
 
We operate a hybrid infrastructure, deploying workloads to AWS and on-premises VMware environments. Infrastructure is defined using Infrastructure as Code, and we run a mix of virtual machines, Docker, and Kubernetes, with a growing focus on containerised, microservice-based workloads. 
 
As we continue to move more workloads onto Kubernetes, you&rsquo;ll have the opportunity to learn and contribute to cloud-native patterns, GitOps, and modern delivery practices.
Our platform tooling includes:
<ul><li>Terraform, Ansible, and Python for infrastructure and automation</li>
<li>Jenkins for CI pipelines and Argo CD for GitOps-based delivery</li>
<li>Docker and Kubernetes for containerised workloads</li>
<li>Experience with these tools is helpful, but we value strong fundamentals and a willingness to learn just as highly.</li>
</ul>
You&rsquo;re someone who:
<ul><li>Enjoys hands-on engineering and learning by doing</li>
<li>Understands the basics of cloud infrastructure, containers, and automation</li>
<li>Cares about reliability, security, and maintainability</li>
<li>Communicates clearly and works well with others</li>
<li>Is curious about new tools and practices and thoughtful about adopting them</li>
<li>Wants to grow into greater technical ownership and influence over time</li>
</ul>
Job Duties
You&rsquo;ll contribute directly to the day-to-day evolution and reliability of the platform, including:
<ul><li>Building and maintaining infrastructure using Terraform, Ansible, and Python</li>
<li>Supporting and improving CI/CD pipelines and deployment workflows</li>
<li>Helping operate and enhance our Kubernetes environments</li>
<li>Working with engineering teams to troubleshoot issues and improve reliability</li>
<li>Contributing to platform standards, documentation, and shared tooling</li>
<li>Automating repetitive tasks and removing manual processes</li>
</ul>
You won&rsquo;t be expected to have all the answers, but you will be expected to ask good questions, learn quickly, and take ownership of the solutions you help build.
Knowledge, Skills and Experience
Essential
<ul><li>Background in Platform/OS engineering, both Linux and Windows experience is preferred.</li>
<li>BSc in Computer Science or equivalent, or proven industry experience</li>
<li>Experience using configuration management such as Ansible and Terraform</li>
<li>Experience with containers using both Docker and Kubernetes</li>
<li>Strong AWS Platform Engineering skills in particular; EC2, S3, IAM and VPC/network configuration</li>
<li>Experience with VMWare is a bonus, especially vSphere, NSX, VCF</li>
<li>Comfortable working in a fast paced, lean and deadline driven organisation.</li>
<li>Able to work under pressure and to ask for support when required</li>
<li>Ability to quickly undertake evaluation of competing products to determine which best meets the company&rsquo;s requirements</li>
<li>Able to automate complex operational and technical processes using industry standard tools</li>
<li>In-depth knowledge of cloud environments and typical technology stacks employed in then</li>
</ul>
Desirable
<ul><li>iGaming experience: Previous experience within the betting, iGaming, or real-time gaming industry is highly advantageous.</li>
<li>Microservices architecture: Experience building, deploying, and maintaining microservices and event-driven systems.</li>
<li>Data technologies: Familiarity with data platforms and services such as RabbitMQ, Kafka, Redis, or MariaDB/MySQL.</li>
<li>Monitoring tools: Experience with application performance monitoring (APM) and observability tools like Grafana or Datadog.</li>
<li>FinOps: Understanding cost management and FinOps concepts within cloud environments.</li>
</ul>
What is in it for me? 
 
We offer a variety of competitive benefits, some of which vary depending on the role you&rsquo;re recruited to. Some of what you can expect in this role includes:
<ul><li>A competitive rate of pay and pension contribution ( &pound;40,000-&pound;65,000)</li>
<li>Generous discretionary bonus schemes, incentives and competitions</li>
<li>An annual leave entitlement that increases with length of service</li>
<li>Access to an online GP 24/7, 365 days a year for you and your immediate family.</li>
<li>Employee wellbeing support through our Employee Assistance Programme</li>
<li>Enhanced Maternity &amp; Paternity Pay</li>
<li>Long Service Recognition</li>
<li>Access to a pay day savings scheme, financial coach and up to 40% of your earned wage ahead of payday, through Wagestream.</li>
</ul>
For More information, visit our https://betfredcareers.com/why-join/</div>

Platform Engineer

The University of Manchester

<div>
 We are seeking a motivated and collaborative individual to join our team as a Senior Platform Engineer. This role offers an exciting opportunity to contribute to the management of the Cloud estate (Azure, GCP, AWS) and maturing of DevOps to enable development teams to deliver cloud services at pace, within a dynamic and inclusive environment.
 
 
 
 You will be responsible for:
 
 
 
 <ul>
 <li>
 Applying Infrastructure as Code (IaC) principles to maintain consistency and reproducibility in cloud infrastructure.
 </li>
 <li>
 Developing a reliable and scalable cloud-based infrastructure service to support continuous and secure delivery of software solutions that meet the evolving needs of key stakeholders.
 </li>
 <li>
 Supervising undergraduate and postgraduate dissertations.
 </li>
 <li>
 Contributing to the identification, evaluation and adoption of tools, technique and processes to create a robust and cost-effective cloud-based platform.
 
 
 
 </li>
 </ul>
 
 About You
 
 
 
 We encourage applications from individuals with a wide range of backgrounds and experiences. You should demonstrate:
 
 
 
 Essential Criteria:
 
 
 
 <ul>
 <li>
 Hands-on experience with one or more major cloud platforms such as Azure, AWS, or GCP.
 </li>
 <li>
 Familiarity with automating the delivery of Infrastructure as Code (IaC) using Terraform.
 </li>
 <li>
 Comfort with code repository management tools like GitLab, GitHub, or Bitbucket.
 </li>
 <li>
 A strong understanding of CI/CD pipelines and their role in modern development practices.
 
 
 
 </li>
 </ul>
 
 Desirable Criteria:
 
 
 
 <ul>
 <li>
 Familiarity with collaboration tools like Atlassian products (Jira, Confluence).
 </li>
 <li>
 Experience in building automation or integrations with platforms like ServiceNOW.
 </li>
 <li>
 A knack for engaging stakeholders and fostering collaboration across teams.
 
 
 
 </li>
 </ul>
 We value transferable skills and real-world experience as much as formal qualifications.
 
 
 
 Our benefits include:
 
 
 
 <ul>
 <li>
 Generous employer contribution pension
 </li>
 <li>
 29 days annual leave plus bank holidays, along with Christmas closure
 </li>
 <li>
 Ride to work and EV car scheme available
 
 
 
 </li>
 </ul>
 For more information, please see University of Manchester Benefits. You can also find information on our Flexible and Hybrid working here.
 
 
 We are an open place of enquiry and challenge. We embrace and celebrate difference, diversity and debate, and we pride ourselves on being a place of education, learning and community where we are able, within the law, to question and test received wisdom, express new ideas and explore controversial or unpopular topics and opinions. Find out more from our Freedom of Speech Policy.
 
 
 
 Enquiries About The Role, Shortlisting And Interviews
 
 
 
 Name: Nisar Khan
 
 
 Email: nisar.khan@manchester.ac.uk
 
 
 
 General enquiries and administrative support
 
 
 
 lewis.burne@manchester.ac.uk
 
 
 
 Technical and job portal support
 
 
 
 https://jobseekersupport.jobtrain.co.uk/support/home
 
 
 
 Applications close at midnight on the closing date.
 
 
 
 Further particulars (with person specification) linked below.
</div>

Senior Platform Engineer

Mindrift

<div>
 
 Mindrift is looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows within our hybrid AI + human system.
 
 
 
 In this role, as an AI Pilot - that's how we refer to this role at Mindrift - you'll collaborate with Tendem Agents that handle repetitive tasks, while you provide critical thinking, domain expertise, and quality control to deliver accurate and actionable results.
 
 
 This part-time remote opportunity is ideal for technical professionals with hands-on experience in web scraping, data extraction and processing.
 
 
 
 What We Do
 
 
 
 The Mindrift platform connects specialists with AI projects from major tech innovators. Our mission is to unlock the potential of Generative AI by tapping into real-world expertise from across the globe.
 
 
 This is a freelance role for a Tendem project. As a
 
 Senior Python Data Scraping Engineer
 
 , you'll handle data scraping tasks requiring technical precision for web extraction and processing, utilizing various tools such as our provided Apify and OpenRouter alongside your own resourceful approaches.
 
 
 
 Key Responsibilities:
 
 
 
 <ul>
 <li>
 Own end-to-end data extraction workflows across complex websites, ensuring complete coverage, accuracy, and reliable delivery of structured datasets
 </li>
 <li>
 Leverage internal tools (Apify, OpenRouter) alongside custom workflows to accelerate data collection, validation, and task execution while meeting defined requirements
 </li>
 <li>
 Ensure reliable extraction from dynamic and interactive web sources, adapting approaches as needed to handle JavaScript-rendered content and changing site behavior
 </li>
 <li>
 Enforce data quality standards through validation checks, cross-source consistency controls, adherence to formatting specifications, and systematic verification prior to delivery
 </li>
 <li>
 Scale scraping operations for large datasets using efficient batching or parallelization, monitor failures, and maintain stability against minor site structure changes
 
 
 </li>
 </ul>
 
 Requirements:
 
 
 
 <ul>
 <li>
 At least 5+ years of relevant experience in data engineering, web scraping, automation, or software development (required)
 </li>
 <li>
 Bachelor's or Master's Degree in Engineering, Applied Mathematics, Computer Science, or related technical fields is a plus
 </li>
 <li>
 Candidates should have a strong technical foundation and practical experience with scripting, automation, and AI-assisted workflows. We are looking for specialists who can solve non-trivial problems, work confidently with LLMs, and systematically collect, structure, and validate data from diverse sources. A methodical, detail-oriented approach and the ability to work independently are essential
 </li>
 <li>
 Strong experience in Python web scraping (BeautifulSoup, Selenium or similar), including dynamic content (JS, AJAX, infinite scroll) and APIs via proxies
 </li>
 <li>
 Proven ability to extract data from complex structures (hierarchies, archived pages, inconsistent HTML)
 </li>
 <li>
 Solid background in data cleaning, normalization, and validation, delivering structured datasets (CSV, JSON, Google Sheets)
 </li>
 <li>
 Demonstrated experience handling anti-bot mechanisms and dynamic site structures at scale
 </li>
 <li>
 Experience with cloud infrastructure (AWS or equivalent) and containerization (Docker) as part of real workflows
 </li>
 <li>
 Hands-on experience with LLM frameworks (LangChain, OpenRouter, or similar) applied to automation tasks
 </li>
 <li>
 Strong attention to detail and commitment to data accuracy
 </li>
 <li>
 Self-directed work ethic with ability to troubleshoot independently
 </li>
 <li>
 A link to GitHub is a plus
 </li>
 <li>
 English proficiency: Upper-intermediate (B2) or above (required)
 
 
 </li>
 </ul>
 
 Project time expectations
 
 
 
 For this project, tasks are estimated to require around 10-20 hours per week during active phases, based on project requirements. This is an estimate, not a guaranteed workload, and applies only while the project is active.
 
 
 
 Compensation
 
 
 
 On this project, contributors can earn up to
 
 $45 per hour equivalent
 
 , depending on their level and pace of contribution.
 
 
 Compensation varies across projects depending on scope, complexity, and required expertise. Please note that other projects on the platform may offer different earning levels based on their requirements.
</div>

Senior Python Data Scraping Engineer (Freelance)

Hippo Digital Limited

About The Role Hippo is a rapidly growing digital consultancy passionate about building and delivering transformative digital solutions for a diverse range of Public and Private sector clients. We are recruiting for a Senior Data Engineer to join our Hippo Herd. We work at the intersection of strategy, design, and technology to solve complex problems and create lasting value. Our collaborative and agile culture empowers our teams to make a genuine impact. As a Senior Data Engineer, you will play an important role in making Hippo the best Consultancy out there. You will work as part of a multi-disciplinary team combining data, design, product, delivery, analysis and engineering to deliver bespoke digital services that make a positive and meaningful impact on organisations and society. We're confident in our abilities, authentic in our approach, and passionate about what we do. You will act as a Senior Consultant to deliver Data Engineering services to our clients. Senior Data Engineers at Hippo are experienced practitioners who lead the delivery of complex data systems, ensuring technical excellence and mentoring others to maintain high standards. Our solutions empower our customers to build and support secure, scalable, and well-engineered systems beyond traditional boundaries. We leverage deep data insights and continuous innovation to deliver awesome platforms that allow our customers to understand and get the most from their data and digital services. The Senior Data Engineer will be a key player and implementer in this mission. Please note we are looking for candidates who are looking for growth at the Senior level; therefore, the advertised salary band represents the entry point for this level, allowing for clear progression within the role, which we are very keen to support. Your Role in a Nutshell Lead the production of user-centred data software based on business requirements and best practice. Work collaboratively with colleagues to explore, design and deliver innovative solutions to complex client problems. Maintain and grow client relationships, troubleshooting complex issues through collaboration. Design and manage software development and deployment pipelines, resolving potential bottlenecks before they occur. Communicate and present prototypes, solutions, and progress to internal and external stakeholders in a clear, concise manner. Build great relationships with your team and stakeholders, ensuring that systemic challenges are overcome. Mentoring and coaching other engineers to support their professional development. Promote Hippo&rsquo;s Data Herd internally and externally through blogs, case studies, and workshops. Skills and experience that you need Essential Experience Excellent experience delivering in Python and experience with at least one other core language. Strong expertise in SQL and relational databases. Solid experience with Cloud providers such as AWS, Azure or GCP. Solid experience working with Snowflake and dbt. Strong experience working with different data formats, e.g., CSV, JSON and XML. Expert knowledge in building reliable and scalable Data Pipelines. Deep experience working in an Agile Environment. Proficiency in Test-Driven Development (TDD) or Behaviour Driven Development (BDD). Strong experience with Continuous Integration and Continuous Deployment (CI/CD). Experience mentoring and coaching others on technical best practices. Desirable Experience Previous experience of working on GOV/NHS projects or in a consultancy environment. Experience in Data Modelling. Broader knowledge of IT &mdash; e.g., Security and Networking. What makes us great Alongside working with some of the most talented people out there and on-top of a competitive salary, which we&rsquo;re transparent about from the outset, you can also expect a range of benefits: Contributory Pension Scheme (Hippo 6% &amp; Employee 2%) 25 Days Holiday plus UK Public Holidays Perkbox access for a wide range of discounts Critical illness cover Life assurance and death in service cover Volunteer days Cycle-to-work scheme for the avid cyclists Salary sacrifice electric vehicles scheme Season ticket loans Financial and general wellbeing sessions Flexible benefits scheme with options of: Private health cover Private dental cover Additional company pension contributions Additional holidays (up to an extra 2 days) Wellbeing contribution Charity contributions Tree planting Diversity, Inclusion and Belonging at Hippo At Hippo, we&rsquo;re dedicated to creating a diverse, equitable and inclusive workplace that works for everyone. We understand that having a diverse team unlocks our capacity for innovation, creativity and problem solving. Only by building a community of diverse perspectives, cultures and socio-economic backgrounds can we create an environment where all can contribute and thrive. We actively encourage applications from underrepresented groups including women, ethnic minorities, LGBTQ+, neurodivergent and people with disabilities. We are committed to providing an inclusive and accessible recruitment process that reflects our workplace culture. We are a registered Disability Confident Employer, Mindful Employer, Endometriosis Friendly Employer and a member of the Armed Forces Covenant. Hippo continually strives to remove barriers, provide accommodations and offer reasonable adjustments to ensure equity throughout our practices. Hi, we&rsquo;re Hippo At Hippo, we design with empathy and build for impact. We do this by combining data-informed evidence, human-centred design and software engineering. We're a digital services partner who is genuinely invested in helping our clients thrive as modern organisations. Our delivery methodology is truly agile, from concept to reality, supporting innovation and continuous improvement to achieve your desired outcomes. We firmly believe that technology should serve humanity, not the other way around. We take a human-centred approach to everything we do because we understand that complex problems require a service design approach. This means understanding how users behave and ensuring our solutions work for them in the real world. Our combination of data, design, and engineering delivers bespoke digital services that make a positive and meaningful impact on organisations and society. Have a look through our Website at Our Story &amp; Purpose, Our Culture &amp; Values, Case Studies and Our Solutions &amp; Services to find out some more! Hippo Locations We are headquartered in Leeds and have offices across the UK in Glasgow, Manchester, Birmingham, London and Bristol. We're on the lookout for top talent nationwide but you need to be located within reasonable travelling distance from one of our offices. Given the dynamic nature of a consulting business, you may be required to work on-site at a Hippo office or at an in/out of town client location for a number of days per week (client dependent) and therefore candidates will need to be open/flexible to travel and working on one of those sites at least 2 days per week. We offer a generous relocation support package of up to &pound;8,000 (please ask for terms and conditions) to help make your move a smooth one. Work Location: Hybrid remote in Manchester M2 1DH

Explore 29+ Cloud data engineer in Manchester this July. Find roles across top companies and apply now to boost your career.

29 cloud data engineer jobs In Manchester

Data Engineer

Azure DevOps Engineer

Senior Data Engineer

Platform Engineer

Senior Platform Engineer

Senior Python Data Scraping Engineer (Freelance)

Senior Data Engineer