Data Streaming Engineer

Envision Employment Solutions is currently looking for a Data Streaming Engineer for one of our partners, a global leader in consulting, digital transformation, technology, and engineering services.

Job Summary:
As a Data Streaming Engineer, you will be building and maintaining robust, scalable Kubernetes-based event streaming platforms. You will play a pivotal role in ensuring the reliability and efficiency of our production and development environments, enabling smooth deployments and accurate event reporting.

This position requires flexibility to work on US times and flexibility to travel abroad when needed.

Responsibilities:

• Kubernetes Infrastructure Management:
• Design, provision, and maintain Kubernetes clusters across various environments (cloud, on-premises, hybrid).
• Monitor cluster performance and optimize resource utilization.
• Troubleshoot issues and implement solutions to ensure high availability and stability.
• Splunk Operations & Engineering:
• Manage Splunk infrastructure including indexers, search heads.
• Troubleshoot ingestion issues, latency, and indexing delays across distributed environments.
• Develop and maintain SPL queries, saved searches, alerts, and dashboards.
• Perform capacity planning, performance tuning, and upgrade planning for Splunk components.
• Implement data onboarding strategies and field extractions for new log sources.
• Cribl Pipeline Management:
• Candidate Cribl experience is advantageous but not required.
• Design, build, and optimize Cribl pipelines for log routing, transformation, filtering, and enrichment.
• Integrate Cribl with various data sources and destinations.
• Automate pipeline deployments and configuration using CI/CD and GitOps practices.
• Production Support:
• Participate in incident response and resolution, ensuring minimal downtime and disruption to services.
• Continuously analyze and improve the performance, reliability, and security of production environments.

Requirements:

• Bachelor's degree in Engineering, Computer Science, Information Technology, or a related field.
• Minimum of 5 years of professional experience.
• Outstanding English communication, both verbal and non-verbal.
• Strong Kubernetes Expertise: Deep understanding of Kubernetes architecture, concepts, and best practices. Hands-on experience with deploying and managing Kubernetes clusters at scale.
• Splunk or ELK Familiarity: Experience working with log data platforms such as Splunk and ELK, including organizing, interpreting, and preparing data for analysis. Familiarity with tools and processes used to manage and streamline data flows across systems.
• GitLab Familiarity: Understanding of GitLab CI/CD features and capabilities. Ability to write efficient and maintainable pipeline scripts.
• Cloud Infrastructure Knowledge: Experience with cloud platforms (AWS, Azure, GCP) and cloud-native technologies.
• Troubleshooting and Problem-Solving: Ability to analyze complex problems, diagnose root causes, and implement effective solutions.
• Collaboration and Communication: Strong communication and interpersonal skills, able to collaborate effectively with cross-functional teams.

Benefits:

• Competitive Salary based on experience
• Social and medical insurance
• Learning, development and career progression