streaming data engineer

CarMax

<div>8117 - Dallas Technology Hub - 5830 Granite Parkway, Plano, Texas, 75024<p></p>
CarMax, the way your career should be!<p><b>
About this job</b></p><p>
The bulk of the data engineer&rsquo;s work would be in building, managing and optimizing data pipelines and then moving these data pipelines effectively into production for key data and analytics consumers (like business/data analysts, data scientists or any persona that needs curated data for operational and analytical data use cases.</p><p></p><p>
Data engineers also need to guarantee compliance with data governance and data security requirements while creating, improving and operationalizing these integrated and reusable data pipelines. This would enable faster data access, integrated data reuse and vastly improved time-to-solution for CarMax&rsquo;s operational and analytical initiatives</p><p><b>
Data Engineer II &ndash; Enterprise Data Services</b></p><p>
We are seeking a Data Engineer with hands‑on, production experience building and operating data pipelines in a cloud environment. This role sits on the <b>Enterprise Data Services</b> team, which owns streaming data ingestion, curation, and delivery for Analytics and Data Science teams.</p><div></div><p><b>
Key Responsibilities</b></p><ul><li>
Design, build, and maintain production-grade data pipelines (streaming and batch)</li><li>
Implement event-driven ingestion and near real‑time processing</li><li>
Build transformations using distributed data processing frameworks</li><li>
Write and maintain clean, testable Python code following software engineering best practices</li><li>
Support CI/CD pipelines, automated deployments, and environment promotions</li><li>
Monitor and troubleshoot pipeline failures, latency issues, and data quality problems</li><li>
Collaborate closely with Data Scientists, Analysts, and platform engineers</li></ul><div></div><p><b>
Required Experience &amp; Skills</b></p><p>
Candidates <b>must</b> have professional, hands‑on experience in most of the following:</p><ul><li>
2+ years of experience as a Data Engineer or Software Engineer working with data</li><li>
Strong experience writing production Python code</li><li>
Experience building and supporting pipelines on Azure or an equivalent cloud platform (AWS/GCP)</li><li>
Hands‑on experience with distributed data processing, such as:<ul><li>
Apache Spark</li><li>
Databricks (or Spark runners such as EMR, Dataproc)</li></ul></li><li>
Experience working with event streaming or messaging platforms, such as:<ul><li>
Azure Event Hubs</li><li>
Apache Kafka / Confluent Kafka</li><li>
Amazon Kinesis</li></ul></li><li>
Practical experience with CI/CD pipelines, version control, and automated deployments</li><li>
Familiarity with data modeling, schema management, and data reliability concepts</li><li>
Experience operating systems in an agile, collaborative engineering team</li></ul><div></div><p><b>
Strongly Preferred</b></p><ul><li>
Supporting production streaming systems with uptime and latency expectations</li><li>
Azure-native services such as:<ul><li>
Azure Databricks</li><li>
Azure Functions (or equivalent serverless frameworks: AWS Lambda, Cloud Functions)</li><li>
Cosmos DB (or comparable NoSQL stores such as DynamoDB, Cassandra)</li></ul></li><li>
Experience working with Analytics or Data Science platform teams</li><li>
Debugging live pipelines and handling operational ownership/on‑call responsibilities</li></ul><div></div><p><b>
Technology Environment (Primary &amp; Equivalent)</b></p><ul><li><b>
Languages:</b> Python (required), SQL, SparkSQL</li><li><b>
Streaming:</b> Event Hubs | Kafka | Kinesis</li><li><b>
Processing:</b> Databricks | Apache Spark | EMR | Dataproc</li><li><b>
Storage:</b> Cosmos DB | DynamoDB | Cassandra</li><li><b>
Serverless:</b> Azure Functions | AWS Lambda</li><li><b>
Cloud:</b> Azure (primary) | AWS | GCP</li><li><b>
DevOps:</b> CI/CD pipelines, automated deployments</li></ul><div></div><p><b>
Who This Role Is For</b></p><p>
This role is a strong fit for someone who:</p><ul><li>
Has already worked on real, production data systems</li><li>
Wants to deepen experience in streaming and cloud‑native data platforms</li><li>
Brings a software engineering mindset to data problems</li><li>
Values ownership, reliability, and continuous learning</li></ul><p></p><p><b>
Work Location and Arrangement: </b>This role will be based out of the CarMax Midtown office, Richmond VA or CarMax Technology Hub, Plano TX and have a Hybrid work arrangement.
</p><ul><li><p>Associates based in Richmond <b>work onsite 4 days per week.</b></p></li><li><p>
Associates based in Plano <b>work onsite 2 days per week.</b></p></li></ul><p><b><br>
</b></p><p><b>Work Authorization:</b> Applicants must be currently authorized to work in the United States on a full-time basis. <b>Sponsorship will not be considered for this specific role.</b></p><p></p><p><b>
About CarMax</b></p><p>
CarMax disrupted the auto industry by delivering the honest, transparent and high-integrity experience customers want and deserve. This innovative thinking around the way cars are bought and sold has helped us become the nation&rsquo;s largest retailer of used cars, with over 250 locations nationwide.</p><p>
Our amazing team of more than 25,000 associates work together to deliver iconic customer experiences. Along the way, we help every associate grow their career and achieve their best, at work and in their community. We are recognized for our commitment to training and diversity and are one of the FORTUNE 100 Best Companies to Work For&reg;.</p><p></p><p>
Our Commitment to Diversity and Inclusion:</p><p>
CarMax is committed to bringing together people from different backgrounds and perspectives, providing employees with a safe, welcoming, and inclusive work environment.</p><p></p><p>
CarMax is an equal opportunity employer, and all qualified candidates will receive consideration for employment without regard to age, race, color, religion, sex, sexual orientation, gender identity, genetic information, national origin, protected veteran status, disability status, or any other characteristic protected by law.</p><p></p><p>
Upon an applicant's request, CarMax will consider reasonable accommodation to complete the CarMax Job Application.</p></div>

Engineer II, Data

TAT IT Technolgies

<div>
 <strong>
  We have an Urgent requirement for Confluent Kafka Engineer with experience in real time data streaming for one of our banking client in Abu Dhabi, UAE
  <br/>
  <br/>
 </strong>
 <strong>
  Strong experience in Confluent Kafka is MUST for this role
  <br/>
  <br/>
 </strong>
 <strong>
  Design, develop, and maintain real-time data streaming solutions using Confluent Kafka&mdash;Must for this role
  <br/>
  <br/>
 </strong>
 <strong>
  Develop and manage Kafka producers, consumers, topics, partitions, and schemas&mdash;Must for this role
  <br/>
  <br/>
 </strong>
 <strong>
  Implement Kafka Streams, Kafka Connect, and integrations with external systems&mdash;-Must for this role
  <br/>
  <br/>
 </strong>
 <strong>
  Job Summary
  <br/>
  <br/>
 </strong>
 We are seeking a highly skilled Confluent Kafka Engineer to join our dynamic team. The ideal candidate will be responsible for the development, User Acceptance Testing (UAT), and production support of our Confluent Kafka-based systems. This role requires deep expertise in Kafka architecture, including Confluent Control Center, KSQLDB, Kafka Streams, and Kafka Connect. The engineer will collaborate closely with cross-functional teams to ensure the smooth operation of our data streaming services and provide support across various environments.
 <br/>
 <br/>
 <strong>
  Development
  <br/>
  <br/>
 </strong>
 <strong>
  Key Responsibilities:
  <br/>
  <br/>
 </strong>
 <ul>
  <li>
   Design, develop, and implement Kafka-based solutions to meet business requirements, utilizing Confluent Control Center, KSQLDB, Kafka Streams, and Kafka Connect.
  </li>
  <li>
   Write and maintain high-quality code for Kafka producers, consumers, and stream processing applications.
  </li>
  <li>
   Develop and manage Kafka connectors for seamless integration with external systems, ensuring data consistency and reliability.
  </li>
  <li>
   Utilize Kafka Streams for real-time processing of streaming data, transforming and enriching data as it flows through the pipeline.
  </li>
  <li>
   Employ KSQLDB for stream processing tasks, including real-time analytics and transformations.
  </li>
  <li>
   Collaborate with data engineers, software developers, and DevOps teams to integrate Kafka solutions with existing systems.
  </li>
  <li>
   Ensure all Kafka-based solutions are scalable, secure, and optimized for performance.
   <br/>
   <br/>
  </li>
 </ul>
 <strong>
  User Acceptance Testing (UAT)
  <br/>
  <br/>
 </strong>
 <ul>
  <li>
   Develop and execute UAT plans to validate Kafka solutions, including components such as Kafka Streams, KSQLDB, and Kafka Connect, before deployment to production.
  </li>
  <li>
   Work closely with QA teams to identify and resolve defects during the UAT phase.
  </li>
  <li>
   Ensure all UAT activities comply with the organization&rsquo;s standards and best practices.
  </li>
  <li>
   Provide detailed reports on UAT outcomes and work with developers to implement necessary fixes.
   <br/>
   <br/>
  </li>
 </ul>
 <strong>
  Production Support
  <br/>
  <br/>
 </strong>
 <ul>
  <li>
   Monitor and maintain Kafka clusters, including components like Confluent Control Center, to ensure high availability and reliability of data streaming services.
  </li>
  <li>
   Troubleshoot and resolve issues related to Kafka performance, latency, and data integrity, including issues specific to Kafka Streams, KSQLDB, and Kafka Connect.
  </li>
  <li>
   Perform routine maintenance tasks such as patching, upgrades, and backups for Kafka clusters and associated components.
  </li>
  <li>
   Implement monitoring solutions to proactively identify and mitigate potential production issues, leveraging Confluent Control Center for comprehensive cluster visibility.
  </li>
  <li>
   Provide 24/7 support for production systems, including participation in on-call rotation.
   <br/>
   <br/>
  </li>
 </ul>
 <strong>
  Qualifications
  <br/>
  <br/>
 </strong>
 Education: Bachelor&rsquo;s degree in Computer Science, Information Technology, or a related field.
 <br/>
 <br/>
 <strong>
  Experience
  <br/>
  <br/>
 </strong>
 <ul>
  <li>
   3+ years of hands-on experience with Apache Kafka and Confluent Kafka in a production environment, including experience with Confluent Control Center, KSQLDB, Kafka Streams, and Kafka Connect.
  </li>
  <li>
   Proven experience in Kafka development, including producer and consumer API, stream processing, and connector development.
  </li>
  <li>
   Experience with Kafka cluster management, including setup, configuration, monitoring, and troubleshooting.
  </li>
  <li>
   Familiarity with distributed systems, microservices architecture, and event-driven design patterns.
  </li>
  <li>
   Experience with cloud platforms (e.g., AWS, Azure) and containerization (Kubernetes) is a plus.
   <br/>
   <br/>
  </li>
 </ul>
 <strong>
  Technical Skills
  <br/>
  <br/>
 </strong>
 <ul>
  <li>
   Proficiency in programming languages such as Java, Python, or Scala.
  </li>
  <li>
   Strong knowledge of Kafka internals, including brokers, zookeepers, topics, partitions, and offsets.
  </li>
  <li>
   Experience with monitoring tools (e.g., Prometheus, Grafana) and logging frameworks (e.g., Log4j, ELK Stack).
  </li>
  <li>
   Proficiency in using Confluent Control Center for monitoring, managing, and optimizing Kafka clusters.
  </li>
  <li>
   Expertise in Kafka Streams for building scalable, fault-tolerant stream processing applications.
  </li>
  <li>
   Experience with KSQLDB for real-time processing and analytics on Kafka topics.
  </li>
  <li>
   Strong understanding of Kafka Connect for integrating Kafka with external data sources and sinks.
  </li>
  <li>
   Understanding of networking, security, and compliance aspects related to Kafka.
  </li>
  <li>
   Familiarity with CI/CD pipelines and automation tools (e.g., Jenkins, GitLab CI).
   <br/>
   <br/>
  </li>
 </ul>
 Skills: bank,streams,kafka,confluent
</div>


Confluent Kafka Engineer-Bank

Visionist, INC

<div><div><b>Active Top Secret (TS/SCI) clearance with polygraph is required.</b></div><div>
</div><div><b>
Visionist has an exciting new, fully FUNDED opportunity for a Cloud Software Engineer.</b> You will be joining a critical mission supporting our customers big data processing platforms. The analytics developed and deployed in these ecosystems are critical to ensuring that the data flowing through the agency can be leveraged by analysts to perform mission critical reporting and decision making. You will be working with the newest technology and methodologies for processing mass amounts of data and distilling them into actionable results. If you like this type of work environment, then this is for you!</div><div>
</div><div>
For over 14 years, Visionist has been solving the Intelligence Community's toughest software and analysis challenges. As a 100% employee-owned company, we prioritize our people&mdash;your job security is assured. We embed small engineering teams with analysts to rapidly identify and solve mission capability gaps playing a critical role in defending our nation&rsquo;s cyber infrastructure &amp; providing expertise in malware analysis, attribution, mapping adversarial infrastructure, pen testing, and operational planning. Our open-door leadership team fosters a supportive culture, where internal growth and promotion opportunities are the norm. Don&rsquo;t just take our word for it&mdash;check out our 4.8-star review on Glassdoor. Join a company that feels like a family with regular happy hours, baseball games, activity clubs and more. Check us out at www.visionistinc.com.
</div><div>
</div><div>-</div><div>
</div><div><b>
Your contributions are&hellip;</b><br>
<ul><li>Leverage Apache Flink to develop analytics to run on a new big data streaming analytic platform</li><li>Support a critical mission system with hundreds of active users</li><li>Work in a full stack environment while focusing on analytic development</li><li>Support the rapid development and deployment of patches and updates to an existing system in a dynamic role</li></ul>
</div><div><b>Requirements for your new career&hellip;</b><br>
<ul><li>Bachelor's degree in a technical field (Additional 2 years of experience may substitute degree)</li><li>6 years of experience in software development</li></ul></div><div><ul><li>One of the following certifications:</li></ul><div>
 AWS Certified Developer <ul><li>- Associate</li>
 AWS Certified Machine Learning <li>- Associate</li>
 AWS Certified Machine Learning <li>- Specialty</li><li>
 AWS DevOps Engineer Professional</li><li>
 Certified Kubernetes Application Developer (CKAD)</li></ul></div><ul><li>Experience with Java, Docker, and Microservice Architecture</li><li>Experience with streaming data frameworks (Flink, Spring Cloud Data Flow, Heron)</li><li>Experience with Version Control (Git, SVN)</li><li>Familiarity with agency data flow formats and standards</li><li>Interest in working on a small expert team that communicates regularly with analysts and willingness to take on tasks, from requirements gathering and design, to deployment</li></ul></div><div>
</div><div><b>
Benefits of becoming a Visionist:</b> Your new career - Visionist, Inc. (visionistinc.com)<br>
<ul><li>We are a <b>100%</b> employee-owned company, so our employees see the benefit of their contributions and have a stake in our overall success!</li><li><b>Competitive 15% retirement contribution! </b>(5% 401K match &amp; 10% ESOP)</li><li><b>4</b> weeks paid time off that is never &ldquo;use or lose&rdquo;, <b>12</b> paid holidays, <b>comp time</b>, <b>overtime</b>, AND <b>flexible work hours</b></li><li><b>80</b> hours of paid parental leave with an additional <b>$8,000</b> supplemental payment upon returning from maternity</li><li><b>Medical, dental, &amp; vision</b> benefits for both individuals and families (those who waive medical benefits will receive an additional <b>$4,160/year</b>)</li><li>Annual <b>lifestyle bonus of $600</b> &ndash; use it towards gyms/fitness, new tech, or your HSA!</li><li>Annual <b>merit increases</b> &amp; <b>performance-based bonuses</b></li><li>Term life insurance, short-term disability, &amp; long-term disability</li></ul></div><div>
</div><div><b>
Salary range:</b> $135,000 - $206,000<br>
<b>Disclaimer: </b>Salary for this position, along with additional compensation options, will be determined on an individual basis following the interview process, considering various factors such as years of experience, skills, education/certifications, contract specifications, market conditions, etc.</div><div>
</div><div>
-</div><div>
</div><div><b>
Not a good fit?</b> Check out our other opportunities: https://jobs.jobvite.com/visionist</div><div>
</div><div><b>
Next steps:</b> Apply online and one of our recruiters will reach out to you. We have a streamlined process of phone screen with a recruiter, interview with a Visionist team at our HQ in Columbia, MD, and that is all!</div><div>
</div><div><b>
Interested in learning more about Visionist and the work we do?</b> Check out our website! https://www.visionistinc.com/what-we-do</div><div>
</div><div>
-</div><div>
</div><div><i>
U.S citizenship required (green card holders and permanent residents are not eligible). Applicants selected will be required to obtain / maintain a government security clearance.</i></div><div>
</div><div><i>
Visionist, Inc. is an Equal Opportunity / Protected Veterans / Individuals with Disabilities employer.</i></div></div>

Cloud Software Engineer (AWS Certification Required)

Keyrock

<div><h1 class="jobSectionHeader"><b>Senior Data Engineer</b></h1><p></p><h1 class="jobSectionHeader"><b>
About Keyrock</b></h1><p>
Since our beginnings in 2017, we've grown to be a leading change-maker in the digital asset space, renowned for our partnerships and innovation.</p><p>
Today, we partner with over 250 team members around the world. Our diverse team hails from 42 nationalities, with backgrounds ranging from self-taught DeFi natives to PhDs. Predominantly remote, we have hubs in London, Brussels, and Singapore, and host regular online and offline hangouts to keep the crew tight.</p><p>
We are trading on more than 80 trading venues, and working with a wide array of asset issuers. As a well-established market maker, our distinctive expertise led us to expand rapidly. Today, our services span market making, options trading, high-frequency trading, OTC, and DeFi trading desks.</p><p>
But we&rsquo;re more than a service provider. We&rsquo;re an initiator. We're pioneers in adopting the Rust Development language for our algorithmic trading, and champions of its use in the industry. We support the growth of Web3 startups through our Accelerator Program. We upgrade ecosystems by injecting liquidity into promising DeFi, RWA, and NFT protocols. And we push the industry's progress with our research and governance initiatives.</p><p>
At Keyrock, we're not just envisioning the future of digital assets. We're actively building it.</p><p></p><h2 class="jobSectionHeader"><b>
About the team and why the role exists</b></h2><p>
The Central Data Team (CDT) is only a few months old, but data has been Keyrock's lifeblood since day one. We're now building the Keyrock Data Platform to give Keyrockers, and the AI agents working alongside them, the data and context they need to act fast and autonomously within agreed boundaries and aligned with our shared goals. Doing that means taking data from across the company and making sense of it in real time for all the functions that depend on it: trading desks, wealth and asset management, product, risk, finance, compliance, and research to name a few.</p><p>
You'd be one of the early hires in CDT and we expect you to contribute to most of the bigger decisions and build work. The standards we settle on and the way the team ends up working are still open.</p><p></p><h2 class="jobSectionHeader"><b>
What You&rsquo;ll Do</b></h2><ul><li><p>
Build streaming and batch pipelines that ingest, normalise, and distribute market, trading, and portfolio data, resilient to feed and exchange failures.</p></li><li><p>
Build the self-serve tooling (SDKs, patterns, templates, AI agents) so other teams publish, consume, and build on data products without waiting on us.</p></li><li><p>
Own data contracts and schema evolution. Keep schema changes from turning into multi-team coordination events.</p></li><li><p>
Design the lakehouse and time-series layer around consumer query patterns.</p></li><li><p>
Build and evolve the Data Governance and Data Quality Framework: stale-feed detection, schema validation, range checks, idempotent writes, lineage, ownership, self-healing.</p></li><li><p>
Build the derived analytics the business runs on: cross-exchange spreads, VWAP at depth, order book microstructure for the desks; portfolio views, exposure, performance for wealth and asset management.</p></li><li><p>
Make observability, cost, and performance first-class from day one.</p></li><li><p>
Treat infrastructure as code (Docker, Terraform, CI/CD) alongside our Central Infrastructure Team.</p></li><li><p>
Work in the open: write things down, partner closely with Architecture, Infrastructure, Platform, and the rest of the teams.</p></li></ul><p></p><h2 class="jobSectionHeader"><b>
What We&rsquo;re Looking For</b></h2><p>
Tools matter less to us than how you think about problems. That said, here's the shape of the person we have in mind.</p><p>
Engineering Craft</p><ul><li><p>
8+ years of building production data systems that other people rely on.</p></li><li><p>
Strong proficiency in Python and SQL: not just being able to write a query, but being able to reason about what the engine is doing with it.</p></li><li><p>
Code that's easy for someone else to read, test, and delete later.</p></li><li><p>
Strong understanding of data modelling for both streaming and analytical workloads.</p></li><li><p>
Efficiency, quality, idempotency, and observability are taken seriously by default.</p></li></ul><p>
Systems Design</p><ul><li><p>
You've designed and operated streaming systems on Kafka, Redpanda, MSK, or Kinesis, and you have opinions about partitioning, consumer groups, offsets, and schema registries.</p></li><li><p>
You've used a time-series store in production (ClickHouse ideally; TimescaleDB, QuestDB, or similar are fine too) and can talk about table design as a function of query patterns.</p></li><li><p>
You've worked with a lakehouse architecture and reason about table layout, partitioning, and compaction as design choices that shape query performance and storage cost.</p></li><li><p>
You build for self-healing and idempotency. Reprocessing is safe, retries don't double-write, and the system recovers without a human in the loop.</p></li></ul><p>
Operational Readiness</p><ul><li><p>
Docker, Terraform, and CI/CD are how you work, not a separate &quot;DevOps&quot; thing.</p></li><li><p>
You think about cost and performance early.</p></li><li><p>
You instrument as you build: logs, metrics, and traces are part of the system from day one.</p></li><li><p>
You design for data quality and governance up front covering contracts, validation, lineage, and ownership</p></li></ul><p>
How You Think and Work</p><ul><li><p>
You reason from first principles when a problem is new, stay pragmatic when it isn't, and update your view when you learn more.</p></li><li><p>
You treat the trading desks, wealth and asset management, product, risk, finance, compliance, and research as customers of what you build, and communicate with them that way.</p></li><li><p>
You optimise for outcomes over output. A smaller, simpler thing that ships and works beats a bigger thing that doesn't.</p></li><li><p>
You take ownership end-to-end: design, ship, operate, improve.</p></li><li><p>
You say what you think including when it's an unpopular take. You change your mind when the argument is better.</p></li><li><p>
You make the people around you better. Reviews are real, juniors grow from working with you, and peers want to work with you again.</p></li><li><p>
You're curious about how markets work. Data engineering on its own won't keep you interested here.</p></li><li><p>
You're honest about what you know and what you don't, and quick to close the gap.</p></li><li><p>
You understand financial market data: order books, trades, reference data, portfolios, exposures. Crypto, TradFi, or both are a strong plus.</p></li></ul><p></p><h2 class="jobSectionHeader"><b>
Nice to Have</b></h2><ul><li><p>
Lakehouse experience with Apache Iceberg or Delta Lake.</p></li><li><p>
Familiarity with DataHub or similar metadata/lineage platforms.</p></li><li><p>
Rust. Some of our performance-critical services are written in it. Interest is welcome; fluency isn't required.</p></li></ul><p></p><h2 class="jobSectionHeader"><b>
What You&rsquo;ll Get</b></h2><ul><li><p>
A from-scratch mandate. You'll be among the first hires in CDT, and the platform, the standards, and the team culture are yours to shape with us.</p></li><li><p>
Strong partners. Close working relationships with Architecture, Infrastructure, Platform, and the desks themselves. You won't be building data in a vacuum.</p></li><li><p>
Autonomy on how you work. Flexible hours, remote-first, business-hours on-call shared across the team.</p></li><li><p>
A competitive salary package, with various benefits.</p></li><li><p>
A team that likes each other. Regular online get-togethers and a yearly onsite where everyone's in the same room.</p></li></ul><p></p><h2 class="jobSectionHeader"><b>
Our Recruitment Process</b></h2><p>
We&rsquo;re after those with the right skills and a conscious choice to join our field. The perfect fit? Someone who&rsquo;s driven, collaborative, acts with ownership and delivers solid, scalable outcomes. As an employer we are committed to building a positive and collaborative work environment. We welcome employees of all backgrounds, and hire, reward and promote entirely based on merit and performance. Due to the nature of our business and external requirements, we perform background checks on all potential employees, passing which is a prerequisite to join Key</p></div>

Senior Data Engineer

Booz Allen Hamilton

<div>Consolidated Data Analytics Platform Brokering Engineer<p><b>
The Opportunity:
</b></p><p>Ever-expanding technology and collection methodologies means that there is more structured and unstructured data available today than ever before. As a data engineer, you know that organizing big data can yield pivotal insights when it is gathered from disparate sources. We need a Data Engineer who is experienced in upgrading and maintaining Kafka clusters in Kubernetes in AWS, as well as utilizing Kafka Schema Registry and Kafka Security Manager (KSM) to manage schema evolution and security.</p><p></p><p>
In this role, you'll use your expertise in designing, developing, and deploying Kafka clusters in a cloud environment, and with Kafka Schema Registry and Kafka Security Manager. Here, you will guide and mentor data engineers, developers, and data consumers in a fast-paced, agile environment, and will oversee the assessment, design, building, and maintenance of scalable platforms for your clients.</p><p></p><p>
Join us. The world can't wait.</p><p></p><p><b>
You Have:</b></p><ul><li>
Experience with Kafka or Confluent in a containerized environment</li><li>
Experience with Apache NiFi in a containerized environment</li><li>
Experience creating data partitioning strategies and monitoring topics for performance</li><li>
Experience deploying and upgrading Kafka clusters in high availability containerized environments</li><li>
Experience utilizing observability platforms, including Prometheus, Grafana, or Elastic, to configure monitoring for data pipelines to ensure high availability and throughput, low latency, and alerting</li><li>
Knowledge of stream processing pipelines and analytics</li><li>
Secret clearance</li><li>
HS diploma or GED</li></ul><p></p><p><b>
Nice If You Have:</b></p><ul><li>
Experience with the Confluent for Kubernetes (CFK) Operator</li><li>
Experience with scripting in Bash or Python</li><li>
Experience deploying and maintaining applications, appliances, or machines aligned to DoD Security Technical Implementation Guidelines (STIGs) and Security Requirements Guides (SRGs)</li><li>
Experience writing playbooks and scripts for automation tools, including Terraform, Ansible, or Puppet, for Infrastructure-as-Code (IaC) and Configuration-as-Code (CaC)</li><li>
Experience in DoW, Intelligence Community, or other regulated environments</li><li>
Knowledge of cybersecurity concepts, including threats, vulnerabilities, security operations, encryption, boundary defense, auditing, authentication, and supply chain risk management</li><li>
Knowledge of Zero Trust Architecture (ZTA) principles</li></ul><p></p><p><b>
Clearance:
</b></p><p>Applicants selected will be subject to a security investigation and may need to meet eligibility requirements for access to classified information; Secret clearance is required.</p><p></p><p><b>
Compensation</b></p><p>
At Booz Allen, we celebrate your contributions, provide you with opportunities and choices, and support your total well-being. Our offerings include health, life, disability, financial, and retirement benefits, as well as paid leave, professional development, tuition assistance, work-life programs, and dependent care. Our recognition awards program acknowledges employees for exceptional performance and superior demonstration of our values. Full-time and part-time employees working at least 20 hours a week on a regular basis are eligible to participate in Booz Allen&rsquo;s benefit programs. Individuals that do not meet the threshold are only eligible for select offerings, not inclusive of health benefits. We encourage you to learn more about our total benefits by visiting the Resource page on our Careers site and reviewing Our Employee Benefits page.</p><p></p>
Salary at Booz Allen is determined by various factors, including but not limited to location, the individual&rsquo;s particular combination of education, knowledge, skills, competencies, and experience, as well as contract-specific affordability and organizational requirements. The projected compensation range for this position is $77,600.00 to $176,000.00 (annualized USD). The estimate displayed represents the typical salary range for this position and is just one component of Booz Allen&rsquo;s total compensation package for employees. This posting will close within 90 days from the Posting Date.<p></p><p><b>
Identity Statement</b></p><p>
As part of the hiring process, we will ask you to complete an identity verification process that leverages advanced biometrics and artificial intelligence to ensure authenticity and protect against identity fraud. You are expected to be on camera during interviews and assessments. We reserve the right to take your picture to verify your identity and prevent fraud.</p><p></p><p><b>
Candidate AI Usage Policy</b></p><p>
AI is a part of our daily work at Booz Allen, and we are committed to the responsible and ethical use of AI tools. However, we want to ensure a fair candidate process based on <b>your </b>own skills and knowledge. As part of this commitment, the use of artificial intelligence (AI) or other tools to assist with responses during interviews (whether in-person or virtual) is prohibited <b>unless permission is explicitly provided</b>.
</p><p></p><p><b>Work Model</b><br>
Our people-first culture prioritizes the benefits of collaboration, whether it occurs in person or virtually. To support engagement and effective communication, employees working virtually are generally expected to have their cameras on during meetings.</p><ul><li><p><b>
Remote</b>: If this position is listed as remote, there may still be occasions when you are required to work in person at a Booz Allen or customer facility.</p></li><li><p><b>
Hybrid</b>: If this position is listed as hybrid, you will be expected to work from a Booz Allen facility frequently, in alignment with leadership expectations and the needs of the role. You may also be required to work from or visit a customer facility.</p></li><li><p><b>
Onsite</b>: If this position is listed as onsite, work will primarily be performed at a Booz Allen office or customer facility, where employees will collaborate directly with colleagues and customers as required by the role.</p></li></ul><p></p><p><b>
Commitment to Non-Discrimination</b></p><p>
All qualified applicants will receive consideration for employment without regard to disability, status as a protected veteran or any other status protected by applicable federal, state, local, or international law.</p></div><p></p>

Consolidated Data Analytics Platform Brokering Engineer

Coforge

<div>
 <p>
  <strong>
   JOB DETAILS:
  </strong>
 </p>
 <p>
  <br/>
 </p>
 <ul>
  <li>
   <strong>
    Role: Lead Data Engineer
   </strong>
  </li>
  <li>
   <strong>
    Skills: Snowflake/Snowpipe, SQL, Python/PySpark, Kafka, Azure, ADLS, ADF, Data Vault, Databricks, Streaming
   </strong>
  </li>
  <li>
   <strong>
    Experience: 10+years
   </strong>
  </li>
  <li>
   <strong>
    Location: Chicago, IL (Onsite Job)
   </strong>
  </li>
 </ul>
 <p>
  <br/>
 </p>
 <p>
  We at Coforge are seeking an experienced
  <strong>
   Lead Data Engineer
  </strong>
  someone with strong experience in
 </p>
 <p>
  Snowflake/Snowpipe, SQL, Python/PySpark, Data Modeling, Data Vault, Kafka and Development of Azure based data platforms, experience in query optimization.
 </p>
 <p>
  <br/>
 </p>
 <ul>
  <li>
   Snowflake/Snowpipe, SQL, Python/PySpark
  </li>
  <li>
   Data Modeling, Data Engineering with Modeling Techniques - hands on experience
  </li>
  <li>
   Must have
   <strong>
    Data Vault
   </strong>
   experience and Real implementation experience
  </li>
  <li>
   Kafka-based streaming, EventHub
  </li>
  <li>
   Lead development of Azure-based data platforms, including ADLS, ADF, Databricks, and CI/CD automation.
  </li>
  <li>
   Streaming
  </li>
  <li>
   Triggers/Task
  </li>
  <li>
   Difference b/w virtual warehouse and serverless compute
  </li>
  <li>
   Why DBT compared to others
  </li>
  <li>
   experience in query optimization
  </li>
 </ul>
 <p>
 </p>
</div>


Search 10000+ Streaming data engineer jobs near you this May. New roles added regularly across leading industries. Apply today.

10000 streaming data engineer jobs Near Me

Engineer II, Data

Confluent Kafka Engineer-Bank

Cloud Software Engineer (AWS Certification Required)

Cloud Software Engineer (AWS Certification Required)

Senior Data Engineer

Consolidated Data Analytics Platform Brokering Engineer

Senior Data Engineer