Data Engineer

Data Engineer — Markets & AI Data Platform

Macro Hive (BGC Group) is a leading independent provider of global macro strategy. We combine best-in-class human and artificial intelligence to provide institutional investors with market-leading investment opportunities

.Our experts leverage large language models, such as those that power chatbots like ChatGPT, to develop innovative, data-driven solutions to complex financial problems and to build state-of-the-art models in search of alpha signals across asset classes

Mission:

Build the data backbone for AI, quant models and client tools.

Owns:

• Market, economic, research, news, internal and Fenics/BGC data pipelines
• Bronze/silver/gold data architecture
• Data quality gates
• Instrument, ticker, country, client, source and theme metadata
• APIs/tables for agents, dashboards and quant models
• Data lineage, entitlements, permissions and monitoring

Must have:

• Strong Python and SQL
• Production ETL/ELT experience
• Cloud data stack: Azure, Databricks, Delta Lake, Snowflake or similar
• Time-series or complex-data experience
• Data quality, monitoring and audit awareness
• Ability to turn messy data into clean model-ready datasets

Nice to have

• Experience with ticker level data using for example kdb+