Abrar Admin

Bespoke Technologies, Inc.

<div>
 
 BT-152 &ndash; Data Engineer
 
 
 
 Skill Level: Mid
 
 
 Location: Chantilly/Herndon
 
 
 <ul>
 <li>
 MUST HAVE AN ACTIVE TS OR TS/SCI CLEARANCE TO APPLY. Those without an active security clearance will not be considered.**
 
 
 </li>
 </ul>
 
 Role Description
 
 
 
 As a Data Engineer, you will be a hands-on builder and a key member of the team creating and sustaining the data lifeblood of the platform. You will apply your technical skills to develop, deploy, and maintain resilient and efficient data pipelines. This role is perfect for a practitioner who is passionate about leveraging modern tools and automation to solve complex data challenges and deliver high-quality data solutions.
 
 
 
 Responsibilities
 
 
 
 <ul>
 <li>
 Design, develop, and maintain robust and scalable data pipelines for both new development and ongoing operations &amp; maintenance (O&amp;M).
 </li>
 <li>
 Build new pipelines using modern, modular patterns like Databricks Delta Live Tables, adhering to established governance standards.
 </li>
 <li>
 Implement reusable pipeline templates and automated monitoring patterns to ensure consistency and scalability across all data flows.
 </li>
 <li>
 Utilize Infrastructure-as-Code (IaC) with tools like Terraform to create consistent and repeatable CI/CD deployments.
 </li>
 <li>
 Integrate automated data quality checks and profiling using frameworks like Great Expectations to ensure data integrity and validate SLAs.
 </li>
 <li>
 Troubleshoot pipeline issues, optimize performance, and contribute to the continuous improvement of O&amp;M processes.
 </li>
 <li>
 Participate in code reviews and create clear documentation for ETL mappings, code, and deployment processes.
 
 
 </li>
 </ul>
 
 Required Qualifications
 
 
 
 <ul>
 <li>
 4+ years of experience in data engineering.
 </li>
 <li>
 Experience with the development and maintenance of extract, transform, and load (ETL) tools and services.
 </li>
 <li>
 Proficiency in Python, SQL, and Spark/PySpark.
 </li>
 <li>
 Experience with cloud data platforms (e.g., AWS, Azure) and data engineering platforms like Databricks, Palantir, or Snowflake.
 </li>
 <li>
 Experience working in an Agile/Scrum environment.
 
 
 </li>
 </ul>
 
 Preferred Qualifications
 
 
 
 <ul>
 <li>
 Direct experience with the data platform.
 </li>
 <li>
 Experience working in high-security environments (e.g., SIPR, JWICS).
 </li>
 <li>
 Hands-on experience with Databricks Delta Live Tables and Terraform.
 </li>
 <li>
 Familiarity with data orchestration tools (e.g., Airflow) and containerization (Docker, Kubernetes).
 </li>
 <li>
 Knowledge of COTS and open-source data engineering tools such as NiFi or ElasticSearch.
 </li>
 </ul>
</div>

Data Engineer

Join Bespoke Technologies, Inc. and explore 1   exciting career opportunities. They're hiring for various roles with options for remote or on-site work. Apply today and become part of their innovative team.

Bespoke Technologies, Inc.

About Company

Data Engineer