Software Team Lead – Data Services & Crawling Systems

📌 Position: Software Team Lead – Data Services & Crawling Systems

Location: Hybrid (Istanbul Office + Remote)

Department: Software & Data Delivery

Work Type: Full-Time

🧭 Position Summary

BrandZone is seeking a Software Team Lead to oversee the planning and delivery of client-facing data services, web crawling systems, and the data pipelines that power our core analytics products.

This role combines technical leadership with operational accountability. You will manage the engineering team responsible for data extraction services (Scrapy, Playwright), oversee the delivery of scheduled crawler jobs, and ensure clean, accurate datasets are delivered to internal systems and client endpoints.

You will work closely with the Technical Account Manager and CTO, coordinating incoming service requests, planning developer workload, and ensuring timely, reliable, and scalable delivery of data.

🔧 Key Responsibilities

·        • Lead the software team responsible for web crawlers, data services, and client data pipelines

·        • Distribute incoming tasks and requests from the Technical Account Manager

·        • Plan and coordinate recurring crawling jobs and Airflow DAG executions

·        • Ensure the integrity and completeness of data delivered to clients

·        • Manage issue tracking, prioritization, and sprint planning

·        • Monitor crawler performance, failures, and recovery strategies

·        • Ensure collaboration between backend, DevOps, and data engineering teams

·        • Take ownership of service SLAs and delivery timelines

·        • Maintain high standards of code quality and system reliability

·        • Support and mentor developers within the team

💼 Qualifications

·        • 5+ years of experience in software or data engineering

·        • 1+ year experience in team leadership or technical management

·        • Strong background in Python, preferably with Scrapy or Playwright experience

·        • Familiarity with scheduling tools like Airflow or Kubernetes CronJobs

·        • Experience with SQL and distributed systems (PostgreSQL, Caouchbase is a plus)

·        • Solid understanding of CI/CD and Git workflows

·        • Strong organizational skills and ability to manage delivery timelines

·        • Preferred: experience in client-facing data delivery or managed data services

·        • Excellent problem-solving, coordination, and communication skills

🎯 You Will Oversee

·        • Scrapy-based web crawlers

·        • Airflow pipelines on Kubernetes

·        • Data delivery pipelines to PostgreSQL, ClickHouse, Azure Blob Storage

·        • Client-specific crawler services (e.g., restaurant info, pricing, stock data)

·        • Coordination of task queues (RabbitMQ or similar)

🎁 What We Offer

·        • A leadership role with real impact on day-to-day operations

·        • End-to-end visibility across crawling, processing, and data delivery layers

·        • A highly technical and autonomous working environment

·        • Collaboration with Product, Account, and Infrastructure teams

·        • Flexible and hybrid work model

All applications will be handled confidentially.