Senior Data Engineer

ABOUT THE TEAM:

We're a passionate team, consisting of a Head of Data, a Data Engineer, an Analytics Engineer and a Senior Data Analyst dedicated to all things data. You'll be at the centre of our expanding Data team. We're enthusiastic about exploring new tools and technologies, and we thrive on brainstorming to solve challenges and apply best practices. Our team is set to grow soon, welcoming Data Engineers, Analytics Engineers, Analysts, and Data Scientists, all playing a pivotal role in Talon.One's development.

ABOUT THE ROLE:

As a Senior Data Engineer / Data Ops, you will be responsible for all engineering tasks related to the data infrastructure, data ingestion and DWH pipelines. You will own our data ingestion workflows (currently based on a Kafka stream) and will make sure that the data from our PostgresDB instances with a very high amount of data is ingested live into BigQuery. Besides, you will manage our overall data platform infrastructure, recommend improvement and make sure to always follow best practices. Finally, you will also of course be involved in the Data Engineering pipelines, assisting in the modelling of various data sources helping literally all departments within the company making better decisions.

ONCE YOU ARE HERE YOU WILL:

• Own the data ingestion streams for all of our client's DBs, from Postgres to BigQuery
• Own the overall data infrastructure: set up, maintain and improve our stack with new technologies for more efficiency and best practices. E.g. improve orchestration
• Write DWH pipelines and improve our overall DWH code to apply best practices and bring more efficiency.
• Be part of a data team composed of various profiles, be at the center of all infrastructure decisions and work closely with other stakeholders from the R&D department, especially the DevOps team.

WHAT WE NEED YOU TO BRING TO THE TABLE:

• 3 -5 years of experience in the Data Engineering / Data Ops field, ideally working on some big data warehouse projects.
• You are familiar with the modern data stack and are able to recommend, set up and maintain all different kinds of components from Data ingestion to automation.
• You have experience with a wide range of tools and technologies within the modern data stack: Kafka, Airflow, Dagster, DBT Core, BigQuery, Lambda functions etc..
• You have experience with general infrastructure / DevOps management technologies: ArgoCD, Kubernetes, Docker, Github, Postgres, GCP etc..
• You always thrive for applying data engineering best practices: consistency checks, testing data reliability, monitoring on top of ingestion pipelines, no double business logic in the code.

ABOUT TECHNOLOGY:

• Kubernetes running on Google Cloud, ArgoCD, Terraform
• PostgreSQL
• Aiven Kafka Connect, Strimzi, Debezium
• DBT cloud, GCP, BigQuery, Fivetran
• We use Go for our API, core logic, and internal tooling
• Cypress for automated end-to-end testing
• Other odds & ends in JavaScript and shell script

• A Research and Development Department of 90+ of engineers, product managers and product designers in Berlin
• Leaders with 8+ years of experience building our promotions engine
• €1,000 annual learning budget and free German language courses to boost your skills
• 30 days of annual leave, plus extra paid days for your birthday and moving day
• Home office setup budget, a monthly home office allowance
• Freedom to work from abroad for up to 90 days worldwide!
• Mental health support with nilo.health and a discounted Urban Sports Club membership
• 20% company subsidy on your pension contributions
• Subsidised BVG public transport ticket and a dog-friendly Berlin office where your furry friend is welcome
• Lease your ideal bike through BusinessBike