Senior Data Engineer

Hampton North is partnering with a mission-driven defense tech (heavy on the tech) company, they're building a modern data platform used by national-level decision makers to understand supply chains, technology readiness, and large-scale operational risk.

We're looking for a Senior Data Engineer who is genuinely obsessed with data quality and loves getting into the weeds of messy, complex datasets. Someone who can lead data lifecycle strategy end to end, is comfortable working directly with end users and subject matter experts, and knows how to turn large scale, noisy government data into something clean, traceable, and actionable.

Compensation: $180k-220k

Location: Pittsburgh, PA or Washington DC (on site)

What you'll be doing:

• Leading data lifecycle strategy across acquisition, ingestion, cleansing, normalization, and linkage
• Identifying, resolving, and linking key entities across datasets to a master data repository
• Applying large-scale optimization techniques including indexing, blocking, and record classification
• Building chain of custody best practices to ensure data accuracy and traceability back to source
• Collaborating across teams to incorporate statistical, ML, and text processing models into existing data infrastructure
• Performing exploratory data analysis, hypothesis testing, and pattern identification on historical data
• Working directly with end users and subject matter experts to build optimal data architectures

And what you'll need to have:

• 6+ years experience programmatically transforming data using Python
• Advanced SQL and strong experience with relational databases including PostgreSQL
• Experience with data pipeline tooling such as Airflow, dbt, or Spark
• Proficiency with CSV, XML, and JSON data formats
• Experience with AWS data services such as S3, Redshift, Glue, or EMR
• Comfortable working with large scale datasets at the terabyte scale