devops engineer

aws data engineer

senior devops engineer

control-m - grafana administrator/developer Jobs in Pakistan

control-m - grafana administrator/developer

ibm datastage administrator Jobs in Pakistan

ibm datastage administrator

confluent kafka infrastructure administrator

Datamatics Global Services Ltd

<div><b>Job Title: Confluent Kafka Infrastructure Administrator</b><br>
<b>Location: Remote (Pak) / Hybrid (Riyadh, KSA)</b><br>
<b>Employment Type: Full-Time / Contract-to-Hire</b><br>
<b>Experience Level: 5+ years</b><br>
<br>
<b>Role Summary</b><br>
<br>
As a <b>Confluent Kafka Infrastructure Administrator</b>, you'll be the operational backbone for our Kafka ecosystem, handling the full lifecycle of clusters from installation to ongoing maintenance. You'll deploy and manage Confluent Platform in multi-environment setups (dev/test/UAT/preprod/prod/DR), ensuring high availability, security, and performance. This hands-on role involves automation, troubleshooting, and collaboration with engineering teams to support real-time data pipelines in production-scale environments.<br>
<br>
<b>Key Responsibilities</b><ul><li><b>
Installation &amp; Setup:</b> Lead the deployment and initial configuration of Confluent Platform (Enterprise/Cloud editions) and Apache Kafka clusters across multiple environments (dev, test, UAT, preprod/prod, DR), including:<ul><li>
Installing brokers, ZooKeeper/KRaft controllers, Schema Registry, Kafka Connect, and ksqlDB using automated tools like Ansible, Terraform, or Confluent CLI/Helm charts on Kubernetes, bare-metal, or cloud (GCP).</li><li>
Configuring topics, partitions, replication factors, and security (SSL/TLS encryption, SASL authentication, ACLs/RBAC via ZooKeeper or KRaft) with zero-downtime setups.</li><li>
Integrating auxiliary services like MirrorMaker 2 or Confluent Replicator for cross-environment replication, and performing initial load testing/health checks with tools like Kafka's perf tools.</li><li>
Automating environment provisioning for reproducibility, including VPC peering, load balancers, and integration with existing infrastructure.</li></ul></li><li><b>
Maintenance &amp; Operations:</b> Oversee day-to-day cluster management, upgrades, and patching in multi-environment landscapes, ensuring &gt;99.9% uptime and compliance with SLAs.</li><li><b>
Monitoring &amp; Troubleshooting:</b> Implement and maintain observability with Prometheus, Grafana, Confluent Control Center; set up alerts for metrics like lag, throughput, and broker health; perform root-cause analysis for incidents (e.g., replication failures, disk exhaustion).</li><li><b>
Optimization &amp; Scaling:</b> Conduct capacity planning, performance tuning (e.g., JVM tweaks, partition balancing), and horizontal/vertical scaling; implement Tiered Storage for cost efficiency in large-scale setups.</li><li><b>
Security &amp; Compliance:</b> Enforce security best practices (OAuth/Kerberos, auditing); manage access controls and ensure GDPR/HIPAA compliance across environments.</li><li><b>
Automation &amp; Documentation:</b> Develop scripts (Python/Bash) for routine tasks like backups, rollouts, and failover; create runbooks and contribute to IaC pipelines (CI/CD with Jenkins/GitHub Actions).</li><li><b>
Collaboration:</b> Partner with data engineers, DevOps, and architects to support POCs, integrations (e.g., Flink/Spark), and environment migrations; provide 24/7 on-call support for prod incidents.</li></ul><br>
<b>
Required Qualifications &amp; Skills</b><ul><li>
Bachelor's in Computer Science/Engineering; Confluent Certified Administrator (CCAAK) or equivalent a plus.</li><li>
5+ years in infrastructure ops; 3+ years hands-on with Confluent Platform &amp; Apache Kafka (KRaft mode preferred).</li><li>
Proven track record in deploying/managing Kafka clusters across multi-environments (dev/test/UAT/preprd/prod/DR); expertise in Ansible/Terraform/Helm for automated installs.</li><li>
Proficiency in Bash/Python scripting; Kafka admin APIs, Connect, Streams, ksqlDB; Confluent CLI, REST Proxy.</li><li>
Containerization (Docker/K8s); CI/CD (Jenkins/GitHub Actions); multi-cloud (AWS/GCP/Azure) with managed services like MSK.</li><li>
Tools like Prometheus/Grafana/ELK; experience with upgrades, backups, DR (MirrorMaker/Replicator), and performance tuning.</li><li>
SSL/TLS, SASL, ACLs/RBAC; auditing and compliance in distributed systems.</li><li>
Strong troubleshooting, documentation, and communication; ability to handle on-call rotation.</li></ul><p>
</p><p>LlA0WcKzEp</p></div>

Confluent Kafka Infrastructure Administrator

<div><b>Job Title: Confluent Kafka Infrastructure Administrator</b><br>
<b>Location: Remote (Pak) / Hybrid (Riyadh, KSA)</b><br>
<b>Employment Type: Full-Time / Contract-to-Hire</b><br>
<b>Experience Level: 5+ years</b><br>
<br>
<b>Role Summary</b><br>
<br>
As a <b>Confluent Kafka Infrastructure Administrator</b>, you'll be the operational backbone for our Kafka ecosystem, handling the full lifecycle of clusters from installation to ongoing maintenance. You'll deploy and manage Confluent Platform in multi-environment setups (dev/test/UAT/preprod/prod/DR), ensuring high availability, security, and performance. This hands-on role involves automation, troubleshooting, and collaboration with engineering teams to support real-time data pipelines in production-scale environments.<br>
<br>
<b>Key Responsibilities</b><ul><li><b>
Installation &amp; Setup:</b> Lead the deployment and initial configuration of Confluent Platform (Enterprise/Cloud editions) and Apache Kafka clusters across multiple environments (dev, test, UAT, preprod/prod, DR), including:<ul><li>
Installing brokers, ZooKeeper/KRaft controllers, Schema Registry, Kafka Connect, and ksqlDB using automated tools like Ansible, Terraform, or Confluent CLI/Helm charts on Kubernetes, bare-metal, or cloud (GCP).</li><li>
Configuring topics, partitions, replication factors, and security (SSL/TLS encryption, SASL authentication, ACLs/RBAC via ZooKeeper or KRaft) with zero-downtime setups.</li><li>
Integrating auxiliary services like MirrorMaker 2 or Confluent Replicator for cross-environment replication, and performing initial load testing/health checks with tools like Kafka's perf tools.</li><li>
Automating environment provisioning for reproducibility, including VPC peering, load balancers, and integration with existing infrastructure.</li></ul></li><li><b>
Maintenance &amp; Operations:</b> Oversee day-to-day cluster management, upgrades, and patching in multi-environment landscapes, ensuring &gt;99.9% uptime and compliance with SLAs.</li><li><b>
Monitoring &amp; Troubleshooting:</b> Implement and maintain observability with Prometheus, Grafana, Confluent Control Center; set up alerts for metrics like lag, throughput, and broker health; perform root-cause analysis for incidents (e.g., replication failures, disk exhaustion).</li><li><b>
Optimization &amp; Scaling:</b> Conduct capacity planning, performance tuning (e.g., JVM tweaks, partition balancing), and horizontal/vertical scaling; implement Tiered Storage for cost efficiency in large-scale setups.</li><li><b>
Security &amp; Compliance:</b> Enforce security best practices (OAuth/Kerberos, auditing); manage access controls and ensure GDPR/HIPAA compliance across environments.</li><li><b>
Automation &amp; Documentation:</b> Develop scripts (Python/Bash) for routine tasks like backups, rollouts, and failover; create runbooks and contribute to IaC pipelines (CI/CD with Jenkins/GitHub Actions).</li><li><b>
Collaboration:</b> Partner with data engineers, DevOps, and architects to support POCs, integrations (e.g., Flink/Spark), and environment migrations; provide 24/7 on-call support for prod incidents.</li></ul><br>
<b>
Required Qualifications &amp; Skills</b><ul><li>
Bachelor's in Computer Science/Engineering; Confluent Certified Administrator (CCAAK) or equivalent a plus.</li><li>
5+ years in infrastructure ops; 3+ years hands-on with Confluent Platform &amp; Apache Kafka (KRaft mode preferred).</li><li>
Proven track record in deploying/managing Kafka clusters across multi-environments (dev/test/UAT/preprd/prod/DR); expertise in Ansible/Terraform/Helm for automated installs.</li><li>
Proficiency in Bash/Python scripting; Kafka admin APIs, Connect, Streams, ksqlDB; Confluent CLI, REST Proxy.</li><li>
Containerization (Docker/K8s); CI/CD (Jenkins/GitHub Actions); multi-cloud (AWS/GCP/Azure) with managed services like MSK.</li><li>
Tools like Prometheus/Grafana/ELK; experience with upgrades, backups, DR (MirrorMaker/Replicator), and performance tuning.</li><li>
SSL/TLS, SASL, ACLs/RBAC; auditing and compliance in distributed systems.</li><li>
Strong troubleshooting, documentation, and communication; ability to handle on-call rotation.</li></ul><p>
</p><p>0e1i0zkjY6</p></div>

<div><b>Job Title: Confluent Kafka Infrastructure Administrator</b><br>
<b>Location: Remote (Pak) / Hybrid (Riyadh, KSA)</b><br>
<b>Employment Type: Full-Time / Contract-to-Hire</b><br>
<b>Experience Level: 5+ years</b><br>
<br>
<b>Role Summary</b><br>
<br>
As a <b>Confluent Kafka Infrastructure Administrator</b>, you'll be the operational backbone for our Kafka ecosystem, handling the full lifecycle of clusters from installation to ongoing maintenance. You'll deploy and manage Confluent Platform in multi-environment setups (dev/test/UAT/preprod/prod/DR), ensuring high availability, security, and performance. This hands-on role involves automation, troubleshooting, and collaboration with engineering teams to support real-time data pipelines in production-scale environments.<br>
<br>
<b>Key Responsibilities</b><ul><li><b>
Installation &amp; Setup:</b> Lead the deployment and initial configuration of Confluent Platform (Enterprise/Cloud editions) and Apache Kafka clusters across multiple environments (dev, test, UAT, preprod/prod, DR), including:<ul><li>
Installing brokers, ZooKeeper/KRaft controllers, Schema Registry, Kafka Connect, and ksqlDB using automated tools like Ansible, Terraform, or Confluent CLI/Helm charts on Kubernetes, bare-metal, or cloud (GCP).</li><li>
Configuring topics, partitions, replication factors, and security (SSL/TLS encryption, SASL authentication, ACLs/RBAC via ZooKeeper or KRaft) with zero-downtime setups.</li><li>
Integrating auxiliary services like MirrorMaker 2 or Confluent Replicator for cross-environment replication, and performing initial load testing/health checks with tools like Kafka's perf tools.</li><li>
Automating environment provisioning for reproducibility, including VPC peering, load balancers, and integration with existing infrastructure.</li></ul></li><li><b>
Maintenance &amp; Operations:</b> Oversee day-to-day cluster management, upgrades, and patching in multi-environment landscapes, ensuring &gt;99.9% uptime and compliance with SLAs.</li><li><b>
Monitoring &amp; Troubleshooting:</b> Implement and maintain observability with Prometheus, Grafana, Confluent Control Center; set up alerts for metrics like lag, throughput, and broker health; perform root-cause analysis for incidents (e.g., replication failures, disk exhaustion).</li><li><b>
Optimization &amp; Scaling:</b> Conduct capacity planning, performance tuning (e.g., JVM tweaks, partition balancing), and horizontal/vertical scaling; implement Tiered Storage for cost efficiency in large-scale setups.</li><li><b>
Security &amp; Compliance:</b> Enforce security best practices (OAuth/Kerberos, auditing); manage access controls and ensure GDPR/HIPAA compliance across environments.</li><li><b>
Automation &amp; Documentation:</b> Develop scripts (Python/Bash) for routine tasks like backups, rollouts, and failover; create runbooks and contribute to IaC pipelines (CI/CD with Jenkins/GitHub Actions).</li><li><b>
Collaboration:</b> Partner with data engineers, DevOps, and architects to support POCs, integrations (e.g., Flink/Spark), and environment migrations; provide 24/7 on-call support for prod incidents.</li></ul><br>
<b>
Required Qualifications &amp; Skills</b><ul><li>
Bachelor's in Computer Science/Engineering; Confluent Certified Administrator (CCAAK) or equivalent a plus.</li><li>
5+ years in infrastructure ops; 3+ years hands-on with Confluent Platform &amp; Apache Kafka (KRaft mode preferred).</li><li>
Proven track record in deploying/managing Kafka clusters across multi-environments (dev/test/UAT/preprd/prod/DR); expertise in Ansible/Terraform/Helm for automated installs.</li><li>
Proficiency in Bash/Python scripting; Kafka admin APIs, Connect, Streams, ksqlDB; Confluent CLI, REST Proxy.</li><li>
Containerization (Docker/K8s); CI/CD (Jenkins/GitHub Actions); multi-cloud (AWS/GCP/Azure) with managed services like MSK.</li><li>
Tools like Prometheus/Grafana/ELK; experience with upgrades, backups, DR (MirrorMaker/Replicator), and performance tuning.</li><li>
SSL/TLS, SASL, ACLs/RBAC; auditing and compliance in distributed systems.</li><li>
Strong troubleshooting, documentation, and communication; ability to handle on-call rotation.</li></ul><p>
</p><p>dbqHMHtOaf</p></div>

<div><b>Job Title: Lead Confluent Kafka Engineer/Architect</b><br>
<b>Location: Remote (Pak) / Hybrid (Riyadh, KSA)</b><br>
<b>Employment Type: Full-Time / Contract-to-Hire</b><br>
<b>Experience Level: 10+ years (Senior/Lead)</b><br>
<br>
<b>Role Summary</b><br>
As a <b>Lead Confluent Kafka Engineer</b>, you'll architect, design, setup, install, implement and optimize high-throughput data streaming solutions using Confluent Platform and Apache Kafka. You'll lead a team of engineers in delivering production-grade pipelines, ensuring scalability, reliability, and security. This role involves hands-on development, mentoring, and collaborating with data architects, DevOps, and stakeholders to implement event-driven architectures. You'll champion best practices in real-time data processing, from proof-of-concepts to enterprise deployments, including full lifecycle management from installation to optimization.<br>
<br>
<b>Key Responsibilities</b><ul><li><b>
Architecture &amp; Design:</b> Lead the design of scalable Kafka clusters and Confluent-based ecosystems (e.g., Kafka Streams, ksqlDB, Schema Registry, Connect) for on-prem, hybrid, and multi-cloud (GCP) environments.</li><li><b>
Implementation &amp; Development:</b> Build and maintain real-time data pipelines, integrations, and microservices using Kafka producers/consumers; integrate with tools like Flink, Spark, or ML frameworks for advanced analytics.</li><li><b>
Installation &amp; Setup:</b> Oversee the end-to-end installation and initial configuration of Confluent Platform and Apache Kafka clusters, including:<ul><li>
Deploying Confluent Enterprise/Community editions on Kubernetes (via Helm/Operator), bare-metal servers, or managed cloud services (e.g., Confluent Cloud, GCP).</li><li>
Configuring brokers, ZooKeeper/KRaft mode, topics, partitions, replication factors, and security settings (e.g., SSL/TLS, SASL, ACLs) using Ansible, Terraform, or Confluent CLI.</li><li>
Setting up auxiliary components like Schema Registry, Kafka Connect clusters, and monitoring agents (e.g., JMX exporters) with automated scripts for reproducible environments.</li><li>
Performing initial health checks, load testing (e.g., with Kafka's performance tools), and integration with existing infrastructure (e.g., VPC peering, load balancers).</li></ul></li><li><b>
Operations &amp; Maintenance:</b> Oversee monitoring, troubleshooting, performance tuning, and lifecycle management (upgrades, patching) of Kafka/Confluent instances; implement DevSecOps practices for CI/CD pipelines.</li><li><b>
Team Leadership:</b> Mentor junior engineers, conduct code reviews, and drive technical proofs-of-concept (POCs); gather requirements and define standards for Kafka as a managed service (e.g., access controls, documentation).</li><li><b>
Optimization &amp; Innovation:</b> Ensure high availability (&gt;99.99%), fault tolerance, and cost-efficiency; explore emerging features like Kafka Tiered Storage or Confluent Cloud integrations for AI workloads.</li><li><b>
Collaboration &amp; Delivery:</b> Partner with cross-functional teams (data engineers, architects, product owners) to align streaming solutions with business goals; provide thought leadership on event-driven patterns.</li><li><b>
Security &amp; Compliance:</b> Implement RBAC, encryption, and auditing; conduct root-cause analysis for incidents and ensure GDPR/HIPAA compliance in data flows.</li></ul><b>
Required Qualifications &amp; Skills</b><ul><li>
Bachelor's/Master's in Computer Science, Engineering, or related; certifications like Confluent Developer/Administrator a plus.</li><li>
10+ years in software engineering; 5+ years hands-on with Apache Kafka &amp; Confluent Platform (Cloud/Enterprise editions).</li><li>
Proficiency in Java/Scala/Python (8/11+); Kafka Streams/Connect/ksqlDB; Schema Registry; REST/gRPC APIs.</li><li>
Event-driven/microservices design; data pipeline optimization; handling high-volume streams (TB/day scale).</li><li>
Expertise in containerization (Docker/Kubernetes); CI/CD (Jenkins/GitHub Actions); Terraform/Ansible for IaC.</li><li>
Multi-cloud experience (AWS, GCP, Azure); monitoring tools (Prometheus, Grafana, Confluent Control Center).</li><li>
Experience with streaming integrations (e.g., Flink, Spark Streaming for CDC).
</li><li>Contributions to open-source Kafka projects or publications on streaming architectures.
</li><li>Knowledge of AI/ML data pipelines (e.g., Kafka + TensorFlow/PyTorch).
</li><li>Familiarity with observability tools and security (OAuth, Kerberos).
</li><li>Strong problem-solving, communication, and leadership; experience leading POCs and cross-team projects.</li><li>
Agile/Scrum leadership in fast-paced environments.</li><li>
Experience in client facing roles and leading teams.</li></ul><p>
</p><p>eSAVL5n77F</p></div>

Lead Confluent Kafka Engineer / Architect

<div><b>Job Title: Lead Confluent Kafka Engineer/Architect</b><br>
<b>Location: Remote (Pak) / Hybrid (Riyadh, KSA)</b><br>
<b>Employment Type: Full-Time / Contract-to-Hire</b><br>
<b>Experience Level: 10+ years (Senior/Lead)</b><br>
<br>
<b>Role Summary</b><br>
As a <b>Lead Confluent Kafka Engineer</b>, you'll architect, design, setup, install, implement and optimize high-throughput data streaming solutions using Confluent Platform and Apache Kafka. You'll lead a team of engineers in delivering production-grade pipelines, ensuring scalability, reliability, and security. This role involves hands-on development, mentoring, and collaborating with data architects, DevOps, and stakeholders to implement event-driven architectures. You'll champion best practices in real-time data processing, from proof-of-concepts to enterprise deployments, including full lifecycle management from installation to optimization.<br>
<br>
<b>Key Responsibilities</b><ul><li><b>
Architecture &amp; Design:</b> Lead the design of scalable Kafka clusters and Confluent-based ecosystems (e.g., Kafka Streams, ksqlDB, Schema Registry, Connect) for on-prem, hybrid, and multi-cloud (GCP) environments.</li><li><b>
Implementation &amp; Development:</b> Build and maintain real-time data pipelines, integrations, and microservices using Kafka producers/consumers; integrate with tools like Flink, Spark, or ML frameworks for advanced analytics.</li><li><b>
Installation &amp; Setup:</b> Oversee the end-to-end installation and initial configuration of Confluent Platform and Apache Kafka clusters, including:<ul><li>
Deploying Confluent Enterprise/Community editions on Kubernetes (via Helm/Operator), bare-metal servers, or managed cloud services (e.g., Confluent Cloud, GCP).</li><li>
Configuring brokers, ZooKeeper/KRaft mode, topics, partitions, replication factors, and security settings (e.g., SSL/TLS, SASL, ACLs) using Ansible, Terraform, or Confluent CLI.</li><li>
Setting up auxiliary components like Schema Registry, Kafka Connect clusters, and monitoring agents (e.g., JMX exporters) with automated scripts for reproducible environments.</li><li>
Performing initial health checks, load testing (e.g., with Kafka's performance tools), and integration with existing infrastructure (e.g., VPC peering, load balancers).</li></ul></li><li><b>
Operations &amp; Maintenance:</b> Oversee monitoring, troubleshooting, performance tuning, and lifecycle management (upgrades, patching) of Kafka/Confluent instances; implement DevSecOps practices for CI/CD pipelines.</li><li><b>
Team Leadership:</b> Mentor junior engineers, conduct code reviews, and drive technical proofs-of-concept (POCs); gather requirements and define standards for Kafka as a managed service (e.g., access controls, documentation).</li><li><b>
Optimization &amp; Innovation:</b> Ensure high availability (&gt;99.99%), fault tolerance, and cost-efficiency; explore emerging features like Kafka Tiered Storage or Confluent Cloud integrations for AI workloads.</li><li><b>
Collaboration &amp; Delivery:</b> Partner with cross-functional teams (data engineers, architects, product owners) to align streaming solutions with business goals; provide thought leadership on event-driven patterns.</li><li><b>
Security &amp; Compliance:</b> Implement RBAC, encryption, and auditing; conduct root-cause analysis for incidents and ensure GDPR/HIPAA compliance in data flows.</li></ul><b>
Required Qualifications &amp; Skills</b><ul><li>
Bachelor's/Master's in Computer Science, Engineering, or related; certifications like Confluent Developer/Administrator a plus.</li><li>
10+ years in software engineering; 5+ years hands-on with Apache Kafka &amp; Confluent Platform (Cloud/Enterprise editions).</li><li>
Proficiency in Java/Scala/Python (8/11+); Kafka Streams/Connect/ksqlDB; Schema Registry; REST/gRPC APIs.</li><li>
Event-driven/microservices design; data pipeline optimization; handling high-volume streams (TB/day scale).</li><li>
Expertise in containerization (Docker/Kubernetes); CI/CD (Jenkins/GitHub Actions); Terraform/Ansible for IaC.</li><li>
Multi-cloud experience (AWS, GCP, Azure); monitoring tools (Prometheus, Grafana, Confluent Control Center).</li><li>
Experience with streaming integrations (e.g., Flink, Spark Streaming for CDC).
</li><li>Contributions to open-source Kafka projects or publications on streaming architectures.
</li><li>Knowledge of AI/ML data pipelines (e.g., Kafka + TensorFlow/PyTorch).
</li><li>Familiarity with observability tools and security (OAuth, Kerberos).
</li><li>Strong problem-solving, communication, and leadership; experience leading POCs and cross-team projects.</li><li>
Agile/Scrum leadership in fast-paced environments.</li><li>
Experience in client facing roles and leading teams.</li></ul><p>
</p><p>A5ydtxxGoM</p></div>

<div><b>Job Title: Lead Confluent Kafka Engineer/Architect</b><br>
<b>Location: Remote (Pak) / Hybrid (Riyadh, KSA)</b><br>
<b>Employment Type: Full-Time / Contract-to-Hire</b><br>
<b>Experience Level: 10+ years (Senior/Lead)</b><br>
<br>
<b>Role Summary</b><br>
As a <b>Lead Confluent Kafka Engineer</b>, you'll architect, design, setup, install, implement and optimize high-throughput data streaming solutions using Confluent Platform and Apache Kafka. You'll lead a team of engineers in delivering production-grade pipelines, ensuring scalability, reliability, and security. This role involves hands-on development, mentoring, and collaborating with data architects, DevOps, and stakeholders to implement event-driven architectures. You'll champion best practices in real-time data processing, from proof-of-concepts to enterprise deployments, including full lifecycle management from installation to optimization.<br>
<br>
<b>Key Responsibilities</b><ul><li><b>
Architecture &amp; Design:</b> Lead the design of scalable Kafka clusters and Confluent-based ecosystems (e.g., Kafka Streams, ksqlDB, Schema Registry, Connect) for on-prem, hybrid, and multi-cloud (GCP) environments.</li><li><b>
Implementation &amp; Development:</b> Build and maintain real-time data pipelines, integrations, and microservices using Kafka producers/consumers; integrate with tools like Flink, Spark, or ML frameworks for advanced analytics.</li><li><b>
Installation &amp; Setup:</b> Oversee the end-to-end installation and initial configuration of Confluent Platform and Apache Kafka clusters, including:<ul><li>
Deploying Confluent Enterprise/Community editions on Kubernetes (via Helm/Operator), bare-metal servers, or managed cloud services (e.g., Confluent Cloud, GCP).</li><li>
Configuring brokers, ZooKeeper/KRaft mode, topics, partitions, replication factors, and security settings (e.g., SSL/TLS, SASL, ACLs) using Ansible, Terraform, or Confluent CLI.</li><li>
Setting up auxiliary components like Schema Registry, Kafka Connect clusters, and monitoring agents (e.g., JMX exporters) with automated scripts for reproducible environments.</li><li>
Performing initial health checks, load testing (e.g., with Kafka's performance tools), and integration with existing infrastructure (e.g., VPC peering, load balancers).</li></ul></li><li><b>
Operations &amp; Maintenance:</b> Oversee monitoring, troubleshooting, performance tuning, and lifecycle management (upgrades, patching) of Kafka/Confluent instances; implement DevSecOps practices for CI/CD pipelines.</li><li><b>
Team Leadership:</b> Mentor junior engineers, conduct code reviews, and drive technical proofs-of-concept (POCs); gather requirements and define standards for Kafka as a managed service (e.g., access controls, documentation).</li><li><b>
Optimization &amp; Innovation:</b> Ensure high availability (&gt;99.99%), fault tolerance, and cost-efficiency; explore emerging features like Kafka Tiered Storage or Confluent Cloud integrations for AI workloads.</li><li><b>
Collaboration &amp; Delivery:</b> Partner with cross-functional teams (data engineers, architects, product owners) to align streaming solutions with business goals; provide thought leadership on event-driven patterns.</li><li><b>
Security &amp; Compliance:</b> Implement RBAC, encryption, and auditing; conduct root-cause analysis for incidents and ensure GDPR/HIPAA compliance in data flows.</li></ul><b>
Required Qualifications &amp; Skills</b><ul><li>
Bachelor's/Master's in Computer Science, Engineering, or related; certifications like Confluent Developer/Administrator a plus.</li><li>
10+ years in software engineering; 5+ years hands-on with Apache Kafka &amp; Confluent Platform (Cloud/Enterprise editions).</li><li>
Proficiency in Java/Scala/Python (8/11+); Kafka Streams/Connect/ksqlDB; Schema Registry; REST/gRPC APIs.</li><li>
Event-driven/microservices design; data pipeline optimization; handling high-volume streams (TB/day scale).</li><li>
Expertise in containerization (Docker/Kubernetes); CI/CD (Jenkins/GitHub Actions); Terraform/Ansible for IaC.</li><li>
Multi-cloud experience (AWS, GCP, Azure); monitoring tools (Prometheus, Grafana, Confluent Control Center).</li><li>
Experience with streaming integrations (e.g., Flink, Spark Streaming for CDC).
</li><li>Contributions to open-source Kafka projects or publications on streaming architectures.
</li><li>Knowledge of AI/ML data pipelines (e.g., Kafka + TensorFlow/PyTorch).
</li><li>Familiarity with observability tools and security (OAuth, Kerberos).
</li><li>Strong problem-solving, communication, and leadership; experience leading POCs and cross-team projects.</li><li>
Agile/Scrum leadership in fast-paced environments.</li><li>
Experience in client facing roles and leading teams.</li></ul><p>
</p><p>Ps1QAV6bbg</p></div>

Tata Consultancy Services (TCS)

<div></div><div><div><div><p><div><div><div><div><li>Extensive expertise in designing and implementing data load processes using Azure Data Factory, Azure Databricks, Delta Lake, Azure Delta Lake Storage and Python/PySpark</li><br>
<li>Proficient with Databricks &amp; Python</li><br>
<li>Senior developers with Full Database/ Datawarehouse/ DataMart development capabilities</li><br>
<li>Senior SME with SQL Server required.
</li><br>
<li>Proficiency with standard file formats and markup language technology such as JSON, XML, XSLT.</li><br>
<li>Proficiency with Azure Cloud data environments highly desired.</li><br>
<li>Excellent verbal communication skills. Good problem-solving skills. Attention to detail.</li><br>
<li>Proficiency with Data Warehousing principals and design</li><br>
Nice to have<br>
<li>Familiarity with oData Services/Kafka/ Azure Data Factory</li><br>
<li>Familiarity with Terraform, Unity Catalog
</li><br>
<li>Familiarity with other database technology such as Mongo, Cosmos, MySQL or Oracle a plus</li></div>
</div><br>
</div></div></p></div></div><div><div><div><b>Location</b></div>
<div>Hyderabad</div>
</div><div><div><b>Job Function</b></div>
<div>IT INFRASTRUCTURE SERVICES</div>
</div><div><div><b>Role</b></div>
<div>System Administrator</div>
</div><div><div><b>Job Id</b></div>
<div>382870</div>
</div><div><div><b>Desired Skills</b></div>
<div>Azure | Python</div>
</div></div><p>Desired Candidate Profile
</p><div><div><b>Qualifications</b> : BACHELOR OF BUSINESS ADMINISTRATION, BACHELOR OF BUSINESS MANAGEMENT, BACHELOR OF BUSINESS STUDIES, BACHELOR OF COMMERCE</div></div></div><div></div>

Databricks with Python

Explore 598+ Confluent kafka infrastructure administrator in Pakistan this December. Find roles across top companies and apply now to boost your career.

598 confluent kafka infrastructure administrator jobs IN Pakistan

Confluent Kafka Infrastructure Administrator

Confluent Kafka Infrastructure Administrator

Confluent Kafka Infrastructure Administrator

Lead Confluent Kafka Engineer / Architect

Lead Confluent Kafka Engineer / Architect

Lead Confluent Kafka Engineer / Architect

Databricks with Python