Data Engineer

Company Overview

Ibcos Computers Ltd, a division of Constellation Software Inc., is the UK's leading provider of Dealership Management Software to the Agricultural, Construction and Ground Care industries. We help Dealers manage all areas of the business operations from parts and service, through sales and finance, with innovative solutions to achieve their business objectives.

Job Overview

We are seeking a highly motivated Data Engineer to design, build, and maintain the data integrations, APIs, and data pipelines that support our open systems approach to product creation. The successful candidate will develop and optimise end-to-end data workflows, ensuring data quality, availability, and performance. The Data Engineer will play a central role in ensuring data flows smoothly across systems, migrations run reliably, and our management information and reporting capabilities continue to evolve. They will participate in the full data lifecycle, including requirements analysis, solution design, data modelling, data pipelines and ongoing optimization. This role requires a strong understanding of data processing architectures and system integration patterns, with experience leveraging modern data integration technologies such as Apache NiFi, SQL (MySQL) and API-based ingestion frameworks to implement efficient and automated data pipelines.

Working within the division’s R&D organization, the successful candidate will collaborate with cross-functional teams including Product Managers, Development teams, and data stakeholders to deliver robust data integration and reporting solutions that support both operational and strategic business needs. The role will also contribute to the continuous improvement of data architecture, automation practices, and data governance standards across the organisation.

Key Responsibilities

Data Integrations and Pipelines

• Design, develop, and maintain scalable data integrations between internal and external systems.

• Build and optimise ETL/ELT pipelines to support operational and analytical workloads.

• Implement batch, event-driven, and near real-time data ingestion approaches where required to support evolving business needs.

• Proactively monitor pipelines and data workflows, resolving issues relating to data integrity, performance, reliability, and scalability to ensure data quality, consistency, and reliability across all integration points.

• Work with manufacturers, suppliers, customers, and internal teams to integrate, process, and validate pricing data, identifying opportunities to automate repetitive price list updates.

APIs & Data Services

• Design and implement API-based integrations and reusable ingestion frameworks, including handling authentication, rate limits, pagination, schema evolution, and error handling.

• Implement best practices for API performance, versioning, and documentation.

Data Migrations

• Design and execute data migration and system integration processes, including supporting data mergers, validating migrated data through testing, and ensuring interoperability between systems and externally supplied CSV data.

Management Information & Reporting

• Develop and maintain data models and optimised datasets for business intelligence tools such as Power BI and Bold BI, supporting operational and strategic reporting requirements.

Data Governance & Quality

• Work cross-functionally with Product Managers, development teams, account managers, professional services, and other stakeholders while contributing to improvements in data architecture, automation practices, and data governance standards, and supporting ad-hoc tasks as required.

• Implement data validation, monitoring, and error handling processes.

• Champion best practices for data security, privacy, and compliance.

Qualifications and Skills Required

Essential - Strong experience with ETL/ELT tools and data pipeline development.
Essential - Hands‑on experience with data integration platforms or messaging technologies
Essential - Knowledge of Apache Nifi workflows and maintaining them.
Essential - Knowledge of databases including the use of SQL to query and manage data.
Essential - Proven working experience as a data analyst or business data analyst.
Essential - Technical expertise regarding data models, database design development, data mining and segmentation techniques.
Essential - Strong analytical skills with the ability to collect, organize, analyse, and disseminate significant amounts of information with attention to detail and accuracy.
Essential - Experience designing and supporting APIs (REST, GraphQL, or similar).
Essential - Knowledge of statistics and experience using statistical packages for analysing datasets (Excel, Power BI, Bold BI etc.).
Essential - Advance Microsoft Office skills.
Essential - Strong communication skills.
Essential - Strong problem solving skills and the ability to work with complex datasets.
Essential - BSc or equivalent qualification in either Mathematics, Economics, or Statistics, or a related discipline, or equivalent experience.
Desirable - Understanding of data governance frameworks and data quality tooling.
Desirable - Comfortable communicating verbally and in writing across various departments, vendors, and clients.

Suitable for someone who,

• Can communicate concisely and confidently with members of Ibcos and our customer base.

• Is comfortable working independently.

• Is comfortable dealing with data, extracting requirements from discussions and has a keen eye for detail and methodical approach to tasks.

• Is comfortable taking ownership of the full end-to-end process.

• Is comfortable working across areas of the business.

• Has a keen attention to detail and able to meet demanding deadlines.