DataOps Engineer

About Citylogix

Citylogix is a leading provider of data and analytics for smart city transportation infrastructure, leveraging LiDAR, 360° imaging, and AI-powered analytics to create detailed digital maps, and provide predictive analytics for proactive asset management.

About the role

The DataOps Engineer position is central to developing sophisticated data processing pipelines that handle diverse data formats and volumes. This role involves designing and implementing scalable ETL/ELT workflows using modern big data frameworks and orchestration tools. The engineer will create reusable components and optimize processing efficiency to meet demanding performance requirements. The position requires deep technical expertise in distributed systems and data processing patterns. The successful candidate will work at the intersection of data engineering and operations, ensuring pipelines are both functionally robust and operationally excellent.

What you'll do

• Implement orchestration with Airflow/Prefect
• Build reusable components and shared libraries
• Optimize processing performance and costs
• Manage schema evolution and data versioning
• Integrate diverse data sources and formats
• Create monitoring dashboards and metrics

Qualifications

• 3+ years building production data pipelines
• Expertise in big data frameworks (Spark, Hadoop)
• Experience with workflow orchestration tools
• Strong Python/Scala/Java programming skills
• Understanding of distributed systems