ai inference engineer qvac (100% remote worldwide)

data analyst

data engineer

ai developer

ai engineer

ai inference engineer qvac (100% remote worldwide) Jobs in Islamabad

backend ai data pipeline engineer

Seeka Technology

<div>Company Description 
Great internships are not only the ones that prepare you for the work you hope to do after completing your studies, but they are also the ones that help you realise what work you&rsquo;re currently best suited for and where you might really fit in the working world. We give our interns work that help push their limits and capabilities whenever and wherever possible to prepare them for a future where new job opportunities may require you to become more skilled and efficient workers, especially with the rise of innovation in both business and IT.
SEEKA Technologies (Not Seeka Limited) is a project under its parent organization called Fresh Futures Australia which is an education consultant based in both Australia and Malaysia. We are developing and creating a platform that utilises A.I. to help match students and job seekers to the right opportunities relevant to them from Kindergarten up to the University along with vocational training centers and language schools and ofcourse to businesses and companies who need the right candidates. Our mission is to make it easier for anyone to find, filter and apply to educational institutions and companies in a more seamless manner.
We are currently looking to hire interns who want to work on the psychological aspects of human behavior, interaction and productivity with our application or website as well as explore how psychology plays a role in both the education industry and system. We are a company that recognizes the versatility of psychology majors and how applicable their skills are to a whole range of fields related to business, marketing, public relations, social media and more.
Bellow are the important details you will need to take note of:<ul><li>
Only English is spoken on the job</li><li>
The minimum number of internship months we can accept is 2 months</li><li>
Both International Students and Locals are welcome to apply for this position</li></ul> 

Job Description 
About the role
We are looking for a Backend AI &amp; Data Pipeline Engineer to own the end-to-end data processing infrastructure that powers Yuzee's intelligent course and job matching platform. You will design and maintain scalable, event-driven pipelines that process tens of thousands of daily records, generate semantic embeddings, and feed a growing knowledge graph used for personalised career pathway recommendations.
What you'll do<ul><li>
Design and maintain three distinct processing pipelines &mdash; scheduled job ingestion, event-driven course processing, and a periodic knowledge graph builder &mdash; each with independent trigger logic and cost controls</li><li>
Generate and manage semantic embeddings via Amazon Bedrock (Titan v2), index them in MongoDB Atlas Vector Search, and calibrate similarity thresholds to ensure match accuracy</li><li>
Build and maintain a knowledge graph linking jobs, courses, skills, and industries using FP-Growth association rules and archetype-to-SOC code mapping</li><li>
Build and improve a two-stage discovery and matching API on AWS Lambda &mdash; vector retrieval first, then deep eligibility scoring with LLM re-ranking</li><li>
Right-size Fargate Spot instances and design resumable processing loops that tolerate interruption, keeping infrastructure costs under control as data volume scales</li><li>
Maintain and improve daily job scrapers across multiple sources and build institution data scrapers with robust HTML cleaning pipelines</li></ul>
What we're looking for<ul><li>
1+ years of backend engineering experience focused on data pipelines, ML infrastructure, or search systems</li><li>
Hands-on experience with AWS serverless and container services &mdash; Lambda, ECS Fargate, EventBridge, and Step Functions</li><li>
Strong Python skills &mdash; Pandas, async processing, bulk database operations, and text cleaning</li><li>
Familiarity with vector databases and semantic similarity search; MongoDB Atlas Vector Search experience is a strong plus</li><li>
Cost-conscious infrastructure mindset &mdash; you think in per-record compute costs, free tiers, Spot resilience, and right-sizing</li><li>
Ability to document and communicate complex architecture clearly to both technical and non-technical stakeholders</li></ul>
Nice to have<ul><li>
Experience with knowledge graphs or association rule mining (FP-Growth, Apriori)</li><li>
Experience using LLMs for re-ranking or eligibility assessment on top of vector retrieval results</li><li>
Background in edtech, jobtech, or recommendation/matching systems</li></ul> 

Qualifications 
Degree or existing proven experience 
Additional Information 
Benefits<ul><li>
You can work from home for the whole internship period</li><li>
A reference letter can be requested upon completion of internship</li><li>
A bit of flexibility with working time aside from the usual 9am to 6pm (Ex. 8am to 5pm / 7:30am to 4:30pm)</li><li>
The possibility of retainment for part-time or Full-time work post-internship based on your performance, even if you are not based in Malaysia</li></ul></div>

Backend AI & Data Pipeline Engineer

Job Bank Recruitment Network

Job Bank &mdash; AI Business Engine DevelopmentLocation: RemoteMust speak Fluent EnglishAbout Job BankJob Bank is a UK focused platform helping people start recruitment and training businesses through two simple annual plans. We are now building Job Bank AI &mdash; an intelligent system that includes:<ul><li>Recruitment AI</li><li>Training/Course AI</li><li>Business Builder AI</li><li>Marketing/Outreach AI</li><li>AI Assistants (Recruiter / Trainer / Business Coach / Operations)</li><li>Business Engine (AI Tool Suite)</li></ul>We are building a vertical AI platform, not a generic chatbot.Our mission is to create the #1 AI powered business building platform in the UK.Role OverviewWe are looking for an AI Developer / AI Engineer who can:<ul><li>Integrate large language models (OpenAI, Mistral, Groq, Claude)</li><li>Build custom AI workflows</li><li>Fine tune niche models using Job Bank&rsquo;s datasets</li><li>Build intelligent business tools</li><li>Develop AI agents</li><li>Work closely with our product and engineering team</li><li>Deliver fast, clean and high‑quality work</li></ul>You will be responsible for turning Job Bank into an AI powered platform with recruitment intelligence, training intelligence, business-building intelligence, and marketing intelligence.This is a high impact role.Key ResponsibilitiesAI Development<ul><li>Integrate multiple LLM providers (OpenAI, Anthropic, Mistral, Groq).</li><li>Build custom AI workflows using LangChain, LlamaIndex, or similar frameworks.</li><li>Create structured output templates (JSON, Markdown, Steps, Tasks).</li><li>Fine‑tune domain‑specific models (Recruitment, Training, Business, Marketing).</li><li>Build embeddings and vector search for knowledge retrieval.</li><li>Create RAG (Retrieval Augmented Generation) systems.</li><li>Develop AI scoring systems for CVs, content, outreach, etc.</li></ul>AI Tools &amp; Business Engine<ul><li>Build AI tools for:</li><li>Job adverts</li><li>CV scoring</li><li>Outreach writing</li><li>Training/course building</li><li>SOP creation</li><li>Business plan building</li><li>Content creation</li><li>Product creation</li><li>Develop UI + backend logic for these tools.</li></ul>AI Assistants (Agents)<ul><li>Build semi-autonomous agents:</li><li>AI Recruiter Assistant</li><li>AI Training Assistant</li><li>AI Business Coach</li><li>AI Marketing Assistant</li><li>AI Operations Assistant</li><li>Implement memory (short-term + long-term).</li><li>Chain-of-thought planning (hidden).</li><li>Tool calling (search, write files, propose steps).</li></ul>Data Engineering<ul><li>Prepare datasets for fine‑tuning:</li><li>Job ads</li><li>CVs</li><li>Courses</li><li>Training materials</li><li>SOPs</li><li>Business plans</li><li>Marketing frameworks</li><li>Clean, label, and structure data into instruction formats.</li></ul>Collaboration<ul><li>Work with full‑stack developers to integrate AI tools into the platform.</li><li>Work with product to refine features and outputs.</li><li>Work with the founder to align on strategy, direction, and roadmap.</li></ul>Technical Skills (Must Have)AI &amp; ML<ul><li>Experience with OpenAI API, Mistral, Groq, Claude</li><li>Fine‑tuning small/medium models</li><li>Embeddings &amp; vector stores (FAISS, Pinecone, Weaviate, Chroma)</li><li>LangChain / LlamaIndex</li><li>Prompt engineering</li><li>LLM function calling</li><li>RAG systems</li><li>Model evaluation and scoring</li></ul>Backend<ul><li>Python or Node.js</li><li>FastAPI / ExpressJS</li><li>REST + WebSockets</li><li>Clean code principles</li><li>API architecture</li></ul>Frontend(Not required, but a plus)<ul><li>React / Next.js</li><li>UI component building</li><li>Clean UX flows</li></ul>General<ul><li>Strong problem‑solving</li><li>Ability to work quickly</li><li>Experience shipping real AI features</li><li>Ability to think like a product engineer, not just a coder</li></ul>Bonus Skills (Nice to Have)<ul><li>Experience with recruitment technology</li><li>Experience with LMS or course platforms</li><li>Experience with business tools (CRM, project management, etc.)</li><li>Experience building AI agents</li><li>Experience using Groq for ultra-fast inference</li><li>Understanding of UK recruitment/training market (not required)</li></ul>What We Offer<ul><li>Work on a high‑impact AI platform</li><li>Long‑term role with growth potential</li><li>Stable and exciting product roadmap</li><li>Opportunity to build category‑defining AI</li><li>Flexible working</li><li>A team that is supportive, fast, and visionary</li></ul>Why This Role MattersYou will be responsible for:<ul><li>bringing AI intelligence into Job Bank</li><li>creating tools no competitor has</li><li>shaping the future of the UK&rsquo;s small‑business landscape</li></ul>Job Type: Full-timePay: Rs80,000.00 - Rs100,000.00 per monthWork Location: Remote

AI Developer

Taraki

<div>
 Our client
 
 Ruby
 
 is looking for
 
 DevOps Engineer
 
 in
 
 Islamabad.
 
 
 
 
 Job Description:
 
 
 
 
 Role Overview
 
 
 
 As our DevOps Engineer, you will own the infrastructure that powers Ruby AI's products. You'll work closely with backend, frontend, and AI engineering teams to build reliable, secure, and scalable systems. This is a hands-on role where you'll set up infrastructure from the ground up, establish CI/CD practices, implement monitoring, and ensure our payment and data systems meet security and compliance standards.
 
 
 
 Key Responsibilities
 
 
 
 
 Infrastructure Setup &amp; Scaling
 
 
 
 <ul>
 <li>
 Design, provision, and manage AWS infrastructure (EC2, ECS/EKS, VPC, IAM, Lambda, S3) for all Ruby AI services.
 </li>
 <li>
 Implement Infrastructure as Code (IaC) using Terraform, CloudFormation, or AWS CDK for repeatable, version-controlled provisioning.
 </li>
 <li>
 Architect auto-scaling strategies to handle variable workloads, particularly around LLM API traffic patterns.
 </li>
 <li>
 Manage and optimize Cassandra clusters and PostgreSQL (with pgvector) for performance, replication, and high availability.
 
 
 
 </li>
 </ul>
 
 Security &amp; Compliance
 
 
 
 <ul>
 <li>
 Harden infrastructure security including network segmentation, firewall rules, and least-privilege IAM policies.
 </li>
 <li>
 Implement secrets management (AWS Secrets Manager, HashiCorp Vault, or Sealed Secrets) for LLM API keys and payment credentials.
 </li>
 <li>
 Ensure PCI-DSS compliance considerations for the payment system, including encryption at rest and in transit.
 </li>
 <li>
 Conduct regular security audits and vulnerability assessments of deployed infrastructure.
 
 
 
 </li>
 </ul>
 
 Monitoring &amp; Observability
 
 
 
 <ul>
 <li>
 Build a comprehensive observability stack (Prometheus, Grafana,
 </li>
 <li>
 ELK/Loki, CloudWatch) covering all services and databases.
 </li>
 <li>
 Set up alerting for critical metrics: API latency, database health,
 </li>
 <li>
 LLM API error rates, cost anomalies, and payment system uptime.
 </li>
 <li>
 Implement distributed tracing to debug performance issues across microservices.
 </li>
 <li>
 Create dashboards for LLM API usage tracking and cost monitoring across OpenAI, Gemini, and Anthropic.
 
 
 
 </li>
 </ul>
 
 CI/CD &amp; Deployment Automation
 
 
 
 <ul>
 <li>
 Design and maintain CI/CD pipelines (GitHub Actions, GitLab CI, or Jenkins) for backend, frontend, and AI services.
 </li>
 <li>
 Implement blue-green or canary deployment strategies for zero-downtime releases.
 </li>
 <li>
 Containerize services using Docker and manage orchestration with Kubernetes or ECS.
 </li>
 <li>
 Manage environment separation (development, staging, production) with automated promotion workflows
 
 
 
 </li>
 </ul>
 
 Collaboration &amp; Reliability
 
 
 
 <ul>
 <li>
 Work with backend, frontend, and AI engineers to establish deployment workflows and release governance.
 </li>
 <li>
 Build and maintain disaster recovery plans, backup strategies, and runbooks for incident response.
 </li>
 <li>
 Drive on-call culture and incident management processes as the team scales.
 
 
 
 </li>
 </ul>
 
 Required Qualifications
 
 
 
 <ul>
 <li>
 3&ndash;5 years of hands-on DevOps, SRE, or Infrastructure Engineering experience.
 </li>
 <li>
 Strong AWS expertise: VPC, EC2, ECS/EKS, IAM, Lambda, CloudWatch, S3, RDS.
 </li>
 <li>
 Proficiency with Infrastructure as Code: Terraform, CloudFormation, or AWS CDK.
 </li>
 <li>
 Solid experience with Docker and container orchestration (Kubernetes preferred).
 </li>
 <li>
 Experience managing relational databases (PostgreSQL) and distributed databases (Cassandra, DynamoDB, or similar).
 </li>
 <li>
 Hands-on experience building CI/CD pipelines with GitHub Actions, GitLab CI, or Jenkins.
 </li>
 <li>
 Strong knowledge of monitoring and logging tools: Prometheus, Grafana, ELK stack, or similar.
 </li>
 <li>
 Understanding of networking: VPC design, subnetting, load balancers, DNS, and SSL/TLS.
 </li>
 <li>
 Familiarity with secrets management and security best practices.
 </li>
 <li>
 Strong Linux administration and scripting skills (Bash, Python)
 
 
 
 </li>
 </ul>
 
 Nice to Have
 
 
 
 <ul>
 <li>
 Experience with pgvector or vector database operations for AI/ML workloads.
 </li>
 <li>
 Familiarity with LLM API integration patterns, rate limiting, and cost optimization.
 </li>
 <li>
 Experience with GPU instance management or ML model serving infrastructure.
 </li>
 <li>
 Exposure to service mesh technologies (Istio, Linkerd).
 </li>
 <li>
 Experience with payment system infrastructure and PCI-DSS compliance.
 </li>
 <li>
 Cassandra cluster management experience (repair, compaction, replication tuning)
 
 
 
 </li>
 </ul>
 
 What We Offer
 
 
 
 <ul>
 <li>
 Work with founders who have seen it all from idea to IPO, being early at Snowflake. Built multiple venture backed startups with exits to Snowflake and Private Equity funds.
 </li>
 <li>
 The company is backed by tier 1 funds like Flybridge and Inovia Capital.
 </li>
 <li>
 Focus on craft: We value curiosity, clarity, and craft &mdash; and we're looking for engineers who care about solving real problems with elegant, reliable code.
 </li>
 <li>
 Make an impact: You'll be part of a small team and have an outsized impact.
 </li>
 <li>
 Be valued: We offer highly market-competitive compensation
 
 </li>
 </ul>
</div>

DevOps Engineer - Ruby

DATA ENGINEER &mdash; AI &amp; MODEL TRAININGJob Bank &mdash; AI Business Engine DevelopmentLocation: Remote (Pakistan) Language: Must speak Fluent EnglishSalary: Competitive &mdash; Based on Experience---About Job BankJob Bank is a UK‑focused platform helping people start recruitment and training businesses through two simple annual plans (&pound;100 &amp; &pound;200). We are now building Job Bank AI &mdash; a specialised AI system designed to help users create and scale their own recruitment or training business.Our AI ecosystem includes:<ul><li>Recruitment AI</li><li>Training &amp; Course AI</li><li>Business Builder AI</li><li>Marketing/Outreach AI</li><li>AI Assistants (Recruiter / Trainer / Business Coach / Operations)</li><li>Business Engine (AI Tool Suite)</li></ul>We are building a vertical AI platform, with deep industry‑specific intelligence &mdash; NOT a generic chatbot.This is your opportunity to become a foundational part of a fast‑growing AI product used across the UK.---Role OverviewWe are looking for a Data Engineer who can prepare, structure, clean and optimise datasets for AI fine‑tuning and retrieval systems.Your work will directly power:<ul><li>fine‑tuned recruitment models</li><li>training/course intelligence</li><li>business‑building AI</li><li>outreach and marketing AI</li><li>autonomous AI assistants</li><li>AI-driven games and simulations</li></ul>This role is crucial to the accuracy, reliability and performance of Job Bank AI.---Key ResponsibilitiesData Preparation &amp; Engineering<ul><li>Collect datasets related to recruitment, training, business planning, marketing, and operations</li><li>Clean and standardise raw data (text, CSV, JSON, documents)</li><li>Label and structure data into instruction formats for LLM training</li><li>Build datasets for fine‑tuning small/medium models</li><li>Develop evaluation datasets for model scoring</li></ul>Data Architecture &amp; Pipelines<ul><li>Build and maintain ETL pipelines for AI model ingestion</li><li>Create scalable data workflows to support training cycles</li><li>Manage datasets using tools like Pandas, PySpark or equivalent</li><li>Optimise dataset quality, consistency, and token efficiency</li></ul>Vector Databases &amp; Retrieval<ul><li>Work with embeddings and vector databases (FAISS, Chroma, Pinecone, Weaviate)</li><li>Build and maintain retrieval datasets for RAG systems</li><li>Ensure high‑quality indexing for search, scoring and assistant use</li></ul>AI Model Support<ul><li>Support AI/ML engineers during fine‑tuning cycles</li><li>Prepare domain‑specific datasets for niche models</li><li>Validate and test model outputs against evaluation sets</li><li>Assist with dataset revisions and incremental model improvements</li></ul>Collaboration<ul><li>Work with AI Engineers to support model training</li><li>Work with Full‑Stack Developers to integrate datasets into the platform</li><li>Work directly with the founder to align on roadmap and priorities</li></ul>---Technical Skills (Must Have)Data Engineering<ul><li>Data cleaning, validation, normalisation</li><li>ETL pipeline development</li><li>JSON, CSV, XML processing</li><li>Strong Python (Pandas, NumPy)</li><li>Experience with large text datasets</li><li>Dataset versioning and quality control</li></ul>AI/Data Skills<ul><li>Experience preparing datasets for LLM fine‑tuning</li><li>Understanding of instruction tuning formats</li><li>Embeddings &amp; vector stores (FAISS, Pinecone, Chroma)</li><li>RAG data preparation</li><li>Working knowledge of tokenisation and dataset optimisation</li></ul>General<ul><li>Strong attention to detail</li><li>Ability to work quickly and independently</li><li>Fluent English communication skills</li><li>Experience supporting AI development teams</li><li>Ability to think like a product-focused engineer</li></ul>---Bonus Skills (Nice to Have)<ul><li>Experience with recruitment or training datasets</li><li>Knowledge of course design or HR workflows</li><li>Familiarity with LangChain, LlamaIndex, or similar</li><li>Exposure to machine learning pipelines</li><li>Experience working with international/remote teams</li></ul>---What We Offer<ul><li>Competitive salary (based on expertise)</li><li>Long‑term role with growth potential</li><li>Work on a high‑impact AI product</li><li>A stable, ambitious product roadmap</li><li>Flexible remote working</li><li>Supportive, fast‑paced, visionary team</li><li>Opportunity to build category‑defining AI</li></ul>---Why This Role MattersYou will be the engine behind our AI intelligence. Your datasets will shape:<ul><li>how accurately the AI writes job ads</li><li>how well it scores CVs</li><li>how intelligent the business plans are</li><li>how powerful the training/courses become</li><li>how effective the assistants behave</li></ul>Job Type: Full-timePay: Rs80,000.00 - Rs100,000.00 per monthWork Location: Remote

Data Engineer

Cloudelligent

<div>Position Title: Integration Support Engineer 
Job Timings: 8am- 5pm CST (Central Time USA) 
Location: Islamabad 
About Cloudelligent
Cloudelligent is Cloud-native consultancy and AWS Advanced consulting partner! We specialize in providing bespoke cloud solutions to startups, SMB &amp; the public sector (Non-Profit Organizations). Being a next-gen cloud service provider, we help customers to break free from hardware lifecycle and capital expenditures, allowing them to make the most out of their cloud investment. We have an international footprint with a diverse team of domain experts, and we are customer obsessed.<h2 class="jobSectionHeader">
Job Objective</h2>
This is a client-facing, collaborative role. Strong written and verbal communication skills are essential, as it is a high degree of attention to detail and responsiveness. The ideal candidate takes ownership of their workload, communicates proactively, and consistently meets deadlines without requiring close supervision. The position is technical and backend-focused, centered on configuring, supporting, and enhancing integration services rather than core product feature development. 
Responsibilities<ul><li>
Triage, prioritize, and resolve integration tickets in close collaboration with the client.</li><li>
Perform data mapping between Core, Enterprise, and third-party systems.</li><li>
Install, configure, and maintain integration services, including ODBC, EWA, FUSE, and related connectors.</li><li>
Implement service-level code adjustments to support integration workflows.</li><li>
Modify and optimize data transformation logic across systems.</li><li>
Troubleshoot integration failures, connectivity issues, and data inconsistencies</li><li>
Communicate clearly and promptly with the client on ticket status, blockers, and progress.</li><li>
Support backend integration deployments in Windows and Linux environments.</li><li>
Document integration, configurations, resolutions, and system dependencies.</li></ul>
Requirements<ul><li>
4+ years of experience with SQL and database architecture</li><li>
4+ years of experience with data mapping and ETL processes</li><li>
Hands-on experience configuring backend services and system-level integrations</li><li>
Familiarity with ODBC connectivity and database drivers</li><li>
Experience working with integration services and middleware tools</li><li>
Ability to make targeted code updates in service-layer environments</li><li>
Working knowledge of Python, Java, or similar backend languages</li><li>
Understanding of data structures, system connectivity, and backend troubleshooting</li><li>
Exceptional written and verbal communication, able to provide clear, timely updates to clients and internal team members</li><li>
High attention to detail, accurate documentation and thorough validation are non-negotiable</li><li>
Strong responsiveness, expected to be reachable and reply promptly during US business hours</li><li>
Self-directed and dependable, manages workload independently and flags blockers early</li><li>
Collaborative, works effectively within established client workflows and adapts quickly to existing processes</li></ul>
Good to have<ul><li>
Experience in enterprise SaaS or legal technology environments</li><li>
Experience with proprietary or custom integration services</li><li>
Exposure to API-based integrations and service configuration</li><li>
Familiarity with data warehouse environments</li><li>
Prior experience in a contractor or embedded client-facing role</li></ul>
Success in This Role Looks Like<ul><li>
Consistent, timely resolution of integration tickets with clear client communication throughout.</li><li>
Accurate and stable data flow between connected systems.</li><li>
Proactive status updates, no client should have to chase for an answer.</li><li>
Clean documentation and repeatable configuration processes.</li><li>
Backlog reduced steadily while new items are handled without bottleneck.</li></ul>
9XAOl2ZBbF</div>

Integration Support Engineer

Datamatics Technologies

<div>
 
 
 
 
 Job Title:
 
 
 
 
 
 
 
 
 
 Location: Remote (Pak) / Hybrid (Riyadh, KSA)
 
 
 
 
 
 
 
 
 
 Employment Type: Full-Time / Contract-to-Hire
 
 
 
 
 
 
 
 
 
 Experience Level: 6+ years (Senior)
 
 
 
 
 
 
 
 
 
 
 Role Summary
 
 
 
 
 
 
 
 
 As a
 
 Senior Confluent Kafka Engineer
 
 , you'll architect, design, setup, install, implement and optimize high-throughput data streaming solutions using Confluent Platform and Apache Kafka. You'll lead a team of engineers in delivering production-grade pipelines, ensuring scalability, reliability, and security. This role involves hands-on development, mentoring, and collaborating with data architects, DevOps, and stakeholders to implement event-driven architectures. You'll champion best practices in real-time data processing, from proof-of-concepts to enterprise deployments, including full lifecycle management from installation to optimization.
 
 
 
 
 
 
 
 
 
 Key Responsibilities
 
 
 
 
 <ul>
 <li>
 
 
 
 
 
 Architecture &amp; Design:
 
 Lead the design of scalable Kafka clusters and Confluent-based ecosystems (e.g., Kafka Streams, ksqlDB, Schema Registry, Connect) for on-prem, hybrid, and multi-cloud (GCP) environments.
 
 
 
 
 </li>
 <li>
 
 
 
 
 
 Implementation &amp; Development:
 
 Build and maintain real-time data pipelines, integrations, and microservices using Kafka producers/consumers; integrate with tools like Flink, Spark, or ML frameworks for advanced analytics.
 
 
 
 
 </li>
 <li>
 
 
 
 
 
 Installation &amp; Setup:
 
 Oversee the end-to-end installation and initial configuration of Confluent Platform and Apache Kafka clusters, including:
 
 
 
 
 <ul>
 <li>
 
 
 
 
 Deploying Confluent Enterprise/Community editions on Kubernetes (via Helm/Operator), bare-metal servers, or managed cloud services (e.g., Confluent Cloud, GCP).
 
 
 
 
 </li>
 <li>
 
 
 
 
 Configuring brokers, ZooKeeper/KRaft mode, topics, partitions, replication factors, and security settings (e.g., SSL/TLS, SASL, ACLs) using Ansible, Terraform, or Confluent CLI.
 
 
 
 
 </li>
 <li>
 
 
 
 
 Setting up auxiliary components like Schema Registry, Kafka Connect clusters, and monitoring agents (e.g., JMX exporters) with automated scripts for reproducible environments.
 
 
 
 
 </li>
 <li>
 
 
 
 
 Performing initial health checks, load testing (e.g., with Kafka's performance tools), and integration with existing infrastructure (e.g., VPC peering, load balancers).
 
 
 
 
 </li>
 </ul>
 </li>
 <li>
 
 
 
 
 
 Operations &amp; Maintenance:
 
 Oversee monitoring, troubleshooting, performance tuning, and lifecycle management (upgrades, patching) of Kafka/Confluent instances; implement DevSecOps practices for CI/CD pipelines.
 
 
 
 
 </li>
 <li>
 
 
 
 
 
 Team Leadership:
 
 Mentor junior engineers, conduct code reviews, and drive technical proofs-of-concept (POCs); gather requirements and define standards for Kafka as a managed service (e.g., access controls, documentation).
 
 
 
 
 </li>
 <li>
 
 
 
 
 
 Optimization &amp; Innovation:
 
 Ensure high availability (&gt;99.99%), fault tolerance, and cost-efficiency; explore emerging features like Kafka Tiered Storage or Confluent Cloud integrations for AI workloads.
 
 
 
 
 </li>
 <li>
 
 
 
 
 
 Collaboration &amp; Delivery:
 
 Partner with cross-functional teams (data engineers, architects, product owners) to align streaming solutions with business goals; provide thought leadership on event-driven patterns.
 
 
 
 
 </li>
 <li>
 
 
 
 
 
 Security &amp; Compliance:
 
 Implement RBAC, encryption, and auditing; conduct root-cause analysis for incidents and ensure GDPR/HIPAA compliance in data flows.
 
 
 
 
 
 </li>
 </ul>
 
 
 
 
 Required Qualifications &amp; Skills
 
 
 
 
 <ul>
 <li>
 
 
 
 
 Bachelor's/Master's in Computer Science, Engineering, or related; certifications like Confluent Developer/Administrator a plus.
 
 
 
 
 </li>
 <li>
 
 
 
 
 5+ years hands-on with Apache Kafka &amp; Confluent Platform (Cloud/Enterprise editions).
 
 
 
 
 </li>
 <li>
 
 
 
 
 Proficiency in Java/Scala/Python; Kafka Streams/Connect/ksqlDB; Schema Registry; REST/gRPC APIs.
 
 
 
 
 </li>
 <li>
 
 
 
 
 Event-driven/microservices design; data pipeline optimization; handling high-volume streams (TB/day scale).
 
 
 
 
 </li>
 <li>
 
 
 
 
 Expertise in containerization (Docker/Kubernetes); CI/CD (Jenkins/GitHub Actions); Terraform/Ansible for IaC.
 
 
 
 
 </li>
 <li>
 
 
 
 
 Multi-cloud experience (AWS, GCP, Azure); monitoring tools (Prometheus, Grafana, Confluent Control Center).
 
 
 
 
 </li>
 <li>
 
 
 
 
 Experience with streaming integrations (e.g., Flink, Spark Streaming for CDC).
 
 
 
 
 </li>
 <li>
 
 
 
 
 Contributions to open-source Kafka projects or publications on streaming architectures.
 
 
 
 
 </li>
 <li>
 
 
 
 
 Knowledge of AI/ML data pipelines (e.g., Kafka + TensorFlow/PyTorch).
 
 
 
 
 </li>
 <li>
 
 
 
 
 Familiarity with observability tools and security (OAuth, Kerberos).
 
 
 
 
 </li>
 <li>
 
 
 
 Strong problem-solving, communication, and leadership; experience leading POCs and cross-team projects.
 
 
 
 </li>
 <li>
 
 
 
 
 Agile/Scrum leadership in fast-paced environments.
 
 
 
 
 </li>
 <li>
 
 
 
 
 Experience in client facing roles and leading teams.
 
 
 
 
 </li>
 </ul>
</div>

Senior Confluent Kafka Engineer

Better Devices GmbH

About Better DevicesBetter Devices builds cutting-edge electronic systems in partnership with global clients. We combine rigorous engineering, first-principles thinking, and an obsession with quality to deliver impactful devices and technical solutions. Our work spans the full product lifecycle &mdash; from early architecture and prototyping to production and field deployment.We are expanding our go-to-market capabilities and are seeking an experienced GTM &amp; Automation Engineer to design, implement, and optimize scalable outbound systems, automation workflows, and a structured, predictable pipeline for engineering services.Role SummaryWe're hiring a GTM &amp; Automation Engineer to design, build, and maintain automation pipelines that drive lead generation, qualify prospects, and streamline internal operations. You'll connect external signals (e.g., job postings, industry news, company activity) to our CRM and tools, reduce manual work across the business, and create reliable, scalable systems that support predictable growth.This is a high-impact, hands-on role in a small team &mdash; you'll own end-to-end automation from idea to production, directly contributing to new client acquisition and team efficiency.Key Responsibilities<ul><li>Design and maintain automation workflows that integrate external data sources (e.g., LinkedIn, job boards, industry APIs) with internal systems and CRM.</li><li>Build pipelines for lead discovery, enrichment, scoring, and automated outreach/CRM syncing.</li><li>Develop systems to monitor technical hiring signals, company expansions, or industry trends as client acquisition triggers.</li><li>Automate repetitive business processes: proposal generation, reporting, documentation, invoicing reminders, and data syncs.</li><li>Create internal tools, dashboards, and scripts to boost engineering productivity (e.g., project tracking, time logging &rarr; billing).</li><li>Implement monitoring, error handling, logging, and reliability for all workflows to ensure uptime and trust.</li><li>Proactively identify and automate bottlenecks in operations, GTM, and delivery workflows.</li><li>Collaborate closely with founders/engineers to iterate based on real business needs.</li></ul>Required Skills &amp; Experience<ul><li>Strong programming in Python and JavaScript (Node.js).</li><li>Hands-on experience with APIs, webhooks, and integrations.</li><li>Proven track record building automation workflows or data pipelines (e.g., using n8n, Make.com, Zapier, or custom scripts).</li><li>Experience with relational databases and SQL, including building and working with databases for automation pipelines.</li><li>Strong debugging, problem-solving, and ability to build simple, maintainable systems.</li><li>Self-starter mindset &mdash; comfortable owning projects end-to-end in a small team.</li><li>3 years of experience with automation and automation tools.</li></ul>Preferred Skills &amp; Experience<ul><li>Applying AI/GenAI (e.g., OpenAI APIs, local models) for data extraction, summarization, classification, or personalization.</li><li>Web scraping/automation tools (Apify, Playwright, Puppeteer, or BeautifulSoup).</li><li>Experience working with CRMs</li><li>1 years of sales experience</li><li>Building internal tools/dashboards (e.g., Streamlit, Retool, or simple web apps).</li><li>Understanding of B2B sales cycles in technical/engineering services.</li></ul>What Success Looks Like<ul><li>We have dependable automation pipelines that consistently identify, enrich, and route potential clients based on relevant technical and industry signals.</li><li>Manual repetitive tasks are significantly reduced, giving the team more time to focus on high-value delivery work.</li><li>Internal tools and workflows make the business noticeably more efficient and scalable.</li><li>Automation systems are well documented, monitored, and built in a way that they can grow and adapt with the company.</li></ul>Benefits<ul><li>Competitive salary.</li><li>High autonomy and direct impact on growth.</li><li>Performance-based incentives.</li></ul>Our Values Customer Obsession First Principles Thinking Be Brave Invent Your Way Bias for Action Stronger Together Iterate Fast Leverage Technology Commit &amp; Deliver Extreme Ownership Relentless Focus Intentional Quality Simplify Foresight Build Trust &amp; Empower Enjoy the RideJob Type: Full-timeExperience:<ul><li>Automation: 3 years (Required)</li><li>Sales: 1 year (Preferred)</li></ul>Work Location: In person

GTM & Automation Engineer

Explore 314+ Backend ai data pipeline engineer in Islamabad this April. Find roles across top companies and apply now to boost your career.