Data Engineer - Azure/ADF

**Employment Type:** Permanent

**Salary:** Up to £75k

**Location:** in the Central London

**Work Arrangement:** In-office only, five days a week.

---

**Job Title:** Data Engineer

**Experience Required:** 8 Years

**Role Overview:**

We are seeking a Data Engineer to design and implement scalable data solutions, including real-time and ETL/ELT data pipelines. Responsibilities include optimizing our data warehouse, creating Power BI reports, and developing AI-driven solutions using OpenAI APIs.

**Key Responsibilities:**

- Design and implement robust real-time data pipelines from diverse sources.

- Maintain a high-performance data warehouse for reporting and analytics.

- Develop insightful Power BI dashboards and reports for stakeholders.

- Use Azure Data Factory, Azure Functions, and Logic Apps for data integration.

- Employ Python and SQL for data transformation and analysis.

- Leverage OpenAI APIs for AI/ML solutions.

- Collaborate with teams to align data strategy with business goals.

- Ensure data quality, consistency, and compliance.

**Required Qualifications:**

- 7-8 years in Data Engineering, Data Architecture, or related roles.

- Experience with ETL/ELT pipelines and complex data ecosystems.

- Proficiency in Python and strong SQL skills.

- Familiarity wit h Azure services (Data Factory, Logic Apps, etc.).

- Expertise in Power BI for data modeling and visualization.

- Experience with OpenAI APIs or similar services.

- Understanding of data warehousing and data governance.

**Preferred Qualifications:**

- Knowledge of DevOps practices and CI/CD pipelines.

- Familiarity with cloud-native data platforms (e.g., Databricks).

- Understanding of data privacy regulations (e.g., GDPR).