Data Engineer

Senior Data Architect – Data Engineering

Location: San Francisco, CA
Reports To: VP of Engineering
FLSA Status: Exempt
Employment Type: Full-Time
Compensation: $140,000 – $160,000 annually (based on experience)

About Cargomatic

Cargomatic is transforming the local trucking industry with cutting-edge technology that connects shippers and carriers in real time. Every product that humans build, grow, or sell has spent time on a truck. Local trucking is the lifeblood of every regional economy, yet this $82 billion industry still relies heavily on outdated systems. Cargomatic is bringing transparency, efficiency, and intelligence to local freight through modern technology and data-driven solutions.

We are solving complex, real-world logistics problems every day. If you thrive in a fast-paced environment, enjoy building scalable systems, and want to help shape the future of AI-powered logistics, we'd love to meet you.

Position Summary

Cargomatic is seeking a Senior Data Architect – Data Engineering to design and build scalable, cloud-native data infrastructure that powers analytics, machine learning, and AI-driven applications. This role combines deep data architecture expertise with hands-on experience in modern data platforms and LLM-enabled application development.

You will lead the design of enterprise-grade data models, architect RAG systems, implement agentic workflows, and integrate secure, production-ready LLM capabilities into our ecosystem. This is a high-impact role with significant ownership, visibility, and opportunity to shape the future of intelligent logistics technology.

Key Responsibilities

Data Architecture & Engineering

• Design and build scalable, cloud-native data pipelines (batch and streaming) supporting analytics, ML, and AI-powered applications

• Architect enterprise-grade data models across data lakes, warehouses, and real-time systems (Snowflake, Databricks, Kafka, DBT)

• Define standards for data governance, reliability, performance, and cost optimization

• Optimize storage formats and distributed data systems (Parquet, Delta Lake, Iceberg)

AI & LLM-Enabled Systems

• Develop Retrieval-Augmented Generation (RAG) systems integrating structured and unstructured enterprise data

• Design and implement agentic workflows using frameworks such as LangChain, LangGraph, LlamaIndex, n8n, or similar

• Integrate LLM APIs (OpenAI, Anthropic, or similar) into secure, production-ready applications

• Implement guardrails, validation layers, monitoring, and evaluation frameworks to mitigate hallucination, prompt injection, and data security risks

Backend & API Development

• Build secure backend APIs (Python/FastAPI) to expose AI-powered capabilities

• Ensure observability, monitoring, and cost controls across AI and data services

• Contribute to microservices architecture and distributed system design

Collaboration & Leadership

• Partner cross-functionally with Product, Engineering, and Operations to translate business requirements into scalable technical solutions

• Mentor junior engineers and contribute to architectural standards and best practices

• Drive innovation in data engineering and AI-powered logistics systems

Qualifications

• Bachelor's degree in Computer Science or equivalent practical experience

• 8+ years of software or data engineering experience in production environments

• Strong expertise in data modeling, distributed systems, and scalable cloud architectures

• Hands-on experience with ETL/ELT frameworks and streaming technologies (Kafka, Spark, HEVO, Snowflake, DBT, etc.)

• Advanced SQL skills and deep understanding of modern storage formats

• Proficiency in Python and RESTful API development

• Experience integrating LLM APIs into production applications

• Strong understanding of system reliability, observability, and cost management in cloud environments

Desired Experience

• Experience building RAG pipelines including embeddings, vector search, chunking strategies, and hybrid retrieval

• Experience designing multi-agent or agentic AI workflows with orchestration frameworks

• Knowledge of LLM evaluation, monitoring, and tracing tools (LangSmith or similar)

• Experience with microservices architecture and distributed system design

• Exposure to transportation, logistics, or supply chain domains

• Active GitHub contributions or demonstrated passion for emerging AI and data technologies

Why Join Cargomatic?

We offer competitive compensation and a comprehensive benefits package, including:

• Medical, Dental, and Vision insurance

• 401(k) with company match

• Flexible Spending Accounts (FSA)

• Company-paid Life and Disability insurance

• Flexible Paid Time Off (PTO) and company holidays

• Paid Parental Leave

• Employee Assistance Program (EAP)

• Opportunity to build cutting-edge AI solutions in a high-growth logistics technology company

• Collaborative, high-impact team environment

Cargomatic is proud to be an Equal Opportunity Employer. We are committed to creating a diverse and inclusive workplace where all employees feel valued and empowered to succeed.