Overview:
We are seeking an experienced Data Engineer to support the development and maintenance of scalable data infrastructure in a secure, mission-focused environment. The ideal candidate will design and maintain reliable data pipelines, collaborate closely with software engineering teams, and support data processing and analytics within a cloud-based ecosystem.
Responsibilities:
Build and maintain reliable data pipelines that support ingestion, transformation, and delivery of large datasets
Partner with software developers and engineering teams to integrate data solutions into existing systems and applications
Develop and optimize SQL queries to support data retrieval, transformation, and analysis
Manage and maintain data within relational databases including PostgreSQL, Oracle, and MySQL
Develop scripts and automation using Python, Linux, and shell scripting to support data processing workflows
Operate within AWS environments to support cloud-based data infrastructure
Prepare and structure data outputs for downstream systems and analytics platforms, including JSON formats
Manage and process structured and unstructured datasets
Qualifications:
- Active TS/SCI with Polygraph
-
BS degree and 6-10 years of relevant experience
8+ years of experience developing or maintaining data pipelines in collaboration with development teams
4+ years of hands-on experience with Python
4+ years of experience working in Linux environments, including shell scripting
Demonstrated experience writing and maintaining SQL queries
Experience working with AWS cloud services
Experience working with relational databases such as PostgreSQL, Oracle, or MySQL