11 Graduate Data Engineer Databricks Pyspark jobs in Leeds

Role:

The Cloud Infrastructure Engineer is an experienced individual contributor responsible for designing, implementing, and operating secure, scalable, and highly available AWS infrastructure supporting a production-grade, multi-account B2B SaaS platform in the financial services industry.

This role is critical to maintaining platform resilience, security, automation maturity, and operational excellence across production and non-production environments. The engineer operates with moderate autonomy, owning defined areas of the AWS environment while contributing to infrastructure standards, reliability engineering, and security best practices.

Responsibilities

• Design, build, and maintain AWS infrastructure across production and non-production environments

• Support application deployments and underlying platform services required for reliable operation

• Implement and manage infrastructure using Infrastructure as Code (Terraform)

• Configure and maintain AWS services including compute, storage, networking, and managed services

• Monitor infrastructure health, availability, and performance; respond to incidents and perform root cause analysis

• Partner with application engineering and security teams to support system reliability and scalability

• Implement and maintain backup, disaster recovery, and high-availability solutions

• Support automation related to infrastructure provisioning and application deployments

• Manage IAM roles, permissions, and access controls in alignment with security policies

• Contribute to cloud cost monitoring and optimization efforts

• Maintain documentation, runbooks, and operational procedures

• Participate in on-call or incident response rotations as required

Core AWS & Cloud Technologies

Compute & Containers

• Amazon ECS (Elastic Container Service)

• Amazon EC2

• Amazon ECR (Elastic Container Registry)

• AWS Lambda (event-driven workloads)

Networking & Edge

• Amazon VPC (multi-AZ design, subnet segmentation)

• Internet Gateway (IGW)

• VPC Peering

• Elastic Load Balancing (ALB)

• AWS WAF

• Amazon Route 53

• AWS Data Transfer optimization

Databases & Caching

• Amazon RDS (PostgreSQL) and PSQL

• Amazon DocumentDB (MongoDB compatibility)

• Amazon ElastiCache (Redis)

Messaging & Streaming

• Amazon MSK (Managed Streaming for Apache Kafka)

Security & Compliance

• AWS IAM

• AWS KMS

• AWS Secrets Manager

• AWS Config

• AWS CloudTrail

• Amazon GuardDuty

• Amazon Inspector

• AWS WAF

• Auth0

Monitoring & Observability

• Amazon CloudWatch (metrics, logs, alarms, events)

CI/CD & DevOps

• CircleCI

• BitBucket

• Github

• Infrastructure as Code (Terraform)

Storage & Data Lifecycle

• Amazon S3

• Amazon S3 Glacier Deep Archive

Managed Platform Services

• AWS Transfer Family

• Amazon WorkSpaces (administrative environments)

Skills and Experience

• Strong hands-on experience operating production AWS environments in a multi-account architecture.

• Deep experience with containerized platforms (ECS) and distributed system design.

• Proven experience managing relational and document databases in high-availability configurations.

• Strong understanding of secure VPC architecture, ingress/egress control, and network isolation strategies.

• Experience operating Kafka-based streaming architectures (MSK).

• Expertise implementing infrastructure as code using Terraform.

• Experience building and maintaining CI/CD pipelines for containerized workloads.

• Strong knowledge of IAM design, encryption practices, and secrets management.

• Experience implementing monitoring, alerting, and log aggregation for production systems.

• Ability to troubleshoot performance, networking, scaling, and availability issues across distributed systems.

• Experience supporting regulated or compliance-sensitive environments (e.g., financial services).

• Demonstrated ability to leverage AI-assisted development tools (e.g., Cursor, ChatGPT) to accelerate infrastructure automation, troubleshooting, documentation, and code development while maintaining security and compliance standards.

• Strong judgment in the responsible use of AI tools to enhance productivity, improve code quality, and streamline operational workflows within regulated environments.

• Strong collaboration, documentation, and communication skills.

Minimum Qualifications

• Bachelor’s degree in Computer Science, Engineering, or related field, or equivalent practical experience.

• 4–6 years of experience in cloud infrastructure, platform engineering, or systems engineering roles.

• AWS certification (e.g., AWS Certified Solutions Architect – Associate, SysOps Administrator, or equivalent) preferred.

Integrity and Ethics

• All StarCompliance employees are expected to commit to a high standard of personal integrity and carry out their responsibilities in an ethical manner

We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying potential inconsistencies or verification signals in application materials based on available information. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.