Senior Data Engineer - Quality & Automation

Build and support generating or mocking of test data for exploratory analysis and running tests.

Design and build automated tests / jobs of moderate to high scope and complexity across all stages of the data pipeline while demonstrating good coding & design practices and adhering to published coding standards and guidelines.

Build and enhance data quality rules and platforms for observability across the data pipeline.

Debug complex issues, resolve blockers and follow design documents with minimal or no supervision.

Conduct data analysis activities such as source system analysis, data modelling, data dictionary collection, data profiling and source-to-target mapping ensuring delivery on business needs.

Support in updating data inventories and registries as required to keep metadata and data lineage up-to date, following agreed Data Governance standards, guidelines and principles.

Work closely with product owners, analysts, software engineers and architects to understand the technical landscape and context of deliveries to refine complex functional and non-functional requirements and translate it into fit for purpose acceptance tests.

Work on problems of diverse scope where analysis of data requires evaluation of identifiable factors and select methods to validate and automate the solution.

Build test strategies and test plans validating the core business problem and translating them into tests around code functionality, data quality, performance, and security.