DevOps Engineer - Ruby

Our client Ruby is looking for DevOps Engineer in Islamabad.

Job Description:

Role Overview

As our DevOps Engineer, you will own the infrastructure that powers Ruby AI's products. You'll work closely with backend, frontend, and AI engineering teams to build reliable, secure, and scalable systems. This is a hands-on role where you'll set up infrastructure from the ground up, establish CI/CD practices, implement monitoring, and ensure our payment and data systems meet security and compliance standards.

Key Responsibilities

Infrastructure Setup & Scaling

• Design, provision, and manage AWS infrastructure (EC2, ECS/EKS, VPC, IAM, Lambda, S3) for all Ruby AI services.
• Implement Infrastructure as Code (IaC) using Terraform, CloudFormation, or AWS CDK for repeatable, version-controlled provisioning.
• Architect auto-scaling strategies to handle variable workloads, particularly around LLM API traffic patterns.
• Manage and optimize Cassandra clusters and PostgreSQL (with pgvector) for performance, replication, and high availability.
  
  
  

Security & Compliance

• Harden infrastructure security including network segmentation, firewall rules, and least-privilege IAM policies.
• Implement secrets management (AWS Secrets Manager, HashiCorp Vault, or Sealed Secrets) for LLM API keys and payment credentials.
• Ensure PCI-DSS compliance considerations for the payment system, including encryption at rest and in transit.
• Conduct regular security audits and vulnerability assessments of deployed infrastructure.
  
  
  

Monitoring & Observability

• Build a comprehensive observability stack (Prometheus, Grafana,
• ELK/Loki, CloudWatch) covering all services and databases.
• Set up alerting for critical metrics: API latency, database health,
• LLM API error rates, cost anomalies, and payment system uptime.
• Implement distributed tracing to debug performance issues across microservices.
• Create dashboards for LLM API usage tracking and cost monitoring across OpenAI, Gemini, and Anthropic.
  
  
  

CI/CD & Deployment Automation

• Design and maintain CI/CD pipelines (GitHub Actions, GitLab CI, or Jenkins) for backend, frontend, and AI services.
• Implement blue-green or canary deployment strategies for zero-downtime releases.
• Containerize services using Docker and manage orchestration with Kubernetes or ECS.
• Manage environment separation (development, staging, production) with automated promotion workflows
  
  
  

Collaboration & Reliability

• Work with backend, frontend, and AI engineers to establish deployment workflows and release governance.
• Build and maintain disaster recovery plans, backup strategies, and runbooks for incident response.
• Drive on-call culture and incident management processes as the team scales.
  
  
  

Required Qualifications

• 3–5 years of hands-on DevOps, SRE, or Infrastructure Engineering experience.
• Strong AWS expertise: VPC, EC2, ECS/EKS, IAM, Lambda, CloudWatch, S3, RDS.
• Proficiency with Infrastructure as Code: Terraform, CloudFormation, or AWS CDK.
• Solid experience with Docker and container orchestration (Kubernetes preferred).
• Experience managing relational databases (PostgreSQL) and distributed databases (Cassandra, DynamoDB, or similar).
• Hands-on experience building CI/CD pipelines with GitHub Actions, GitLab CI, or Jenkins.
• Strong knowledge of monitoring and logging tools: Prometheus, Grafana, ELK stack, or similar.
• Understanding of networking: VPC design, subnetting, load balancers, DNS, and SSL/TLS.
• Familiarity with secrets management and security best practices.
• Strong Linux administration and scripting skills (Bash, Python)
  
  
  

Nice to Have

• Experience with pgvector or vector database operations for AI/ML workloads.
• Familiarity with LLM API integration patterns, rate limiting, and cost optimization.
• Experience with GPU instance management or ML model serving infrastructure.
• Exposure to service mesh technologies (Istio, Linkerd).
• Experience with payment system infrastructure and PCI-DSS compliance.
• Cassandra cluster management experience (repair, compaction, replication tuning)
  
  
  

What We Offer

• Work with founders who have seen it all from idea to IPO, being early at Snowflake. Built multiple venture backed startups with exits to Snowflake and Private Equity funds.
• The company is backed by tier 1 funds like Flybridge and Inovia Capital.
• Focus on craft: We value curiosity, clarity, and craft — and we're looking for engineers who care about solving real problems with elegant, reliable code.
• Make an impact: You'll be part of a small team and have an outsized impact.
• Be valued: We offer highly market-competitive compensation