Manager of Data Engineering & Storage

Job Purpose :

• The Manager of Data Engineering & Storage will help lead the design, development, and optimization of data pipelines, integration strategies, and storage infrastructure to support the Insurance Authority’s data-driven objectives. The role ensures that data is ingested, processed, and stored securely and efficiently to serve analytical, operational, and regulatory needs.

Key Responsibilities and Activities

Operations Management:

Implement the policies, regulations, procedures, and controls so that all relevant procedural/ legislative requirements are met while delivering high-quality and cost-effective results.

Data Engineering & Storage :

Data Pipeline & Storage Development

• Design and optimize scalable data pipelines for real-time and batch processing.
• Ensure seamless data ingestion, transformation, and delivery from internal and external sources.
• Enhance automation and monitoring capabilities to reduce disruptions and optimize performance.
• Support regulatory data processing requirements and business analytics workflows.

Data Integration and Sharing

• Develop and implement data integration strategies for unifying data across systems and departments.
• Standardize data interoperability through APIs and common formats.
• Manage secure data-sharing processes within IA and with external stakeholders.
• Monitor integration workflows to ensure high performance and compliance.

Data Operations Management

• Oversee daily operations of data systems ensuring high availability and reliability.
• Monitor and report on Insurance Data Hub usage and performance.
• Define and manage access controls, backup, and disaster recovery for the Data Hub.
• Identify and resolve operational issues within data services to minimize service interruptions.
• Drive automation and process standardization to improve efficiency.

Data Architecture and Modelling

• Design and maintain scalable data architectures aligned with IA’s data strategy.
• Build and evolve data models to support current and future data requirements.
• Collaborate with internal teams to align data models with business and analytical needs.
• Coordinate with the Data Quality & Monitoring team to enforce standards and ensure data integrity.

Storage Infrastructure Management

• Manage structured and unstructured data storage systems for optimal performance and reliability.
• Collaborate with IT Infrastructure & Operations for hybrid (cloud and on-premises) storage solutions.
• Implement and regularly test backup, rollback, and recovery mechanisms.
• Support Business Continuity by aligning data storage with disaster recovery strategies.

Security & Compliance Integration

• Enforce data security protocols in coordination with Cybersecurity teams.
• Ensure compliance with internal data governance and external regulatory requirements.
• Acquire and manage compliance-related data for monitoring regulatory adherence.
• Collaborate with Insight Generation & Decision Support teams to evaluate and improve compliance outcomes.
• Perform other activities as and when required.

Qualifications and Requirements

Knowledge and Experience :

• 8+ years or more of relevant experience in data engineering, integration, and infrastructure management or any relevant field.
• Previous experience in in data pipeline tools (e.g., Apache Airflow, Talend), storage platforms (e.g., Hadoop, cloud data lakes), and integration technologies (e.g., APIs, ETL frameworks).
• Strong understanding of data governance, security, and regulatory compliance.
• Experience working with hybrid environments (cloud and on-premises).
• Familiarity with disaster recovery, data privacy standards, and metadata management.

Education and Certifications:

• Bachelor’s degree in Computer Science, Data Engineering, Information Systems, or a related field.
• Relevant certification is preferred