QA Engineer

QA Engineer – AI Products

Location: Lahore, Pakistan (Hybrid: 5 days office, 1 day remote) Experience: 3-5 years (Senior preferred) Salary: PKR 100,000 – 200,000/month Timeline: Hiring urgently. Applications reviewed on rolling basis.

About Entropy Labs

Entropy Labs is an agentic AI development company building production-grade AI systems. We develop our own platforms and deliver bespoke AI solutions for clients in legal, marketing, and enterprise operations.

Current projects:

• Revenue Intelligence Platform — B2B SaaS connecting ERPs, marketing tools, and business systems for automated analytics and AI-powered insights
• AI-Powered Legal Intake System — Conversational AI for law firms including inbound voice agents and post-call transcript analysis
• Creator/Influencer Marketplace — Two-sided platform with AI-powered matching, campaign management, CRM, and payment/escrow

We ship fast—multiple deployments per week across three products. We need someone who can keep quality high without slowing us down.

Role Summary

We're hiring a QA Engineer to own quality assurance across our AI product portfolio. This isn't traditional QA—you'll be testing AI-powered features where outputs aren't always deterministic, voice systems where latency matters as much as correctness, and complex integrations with third-party APIs.

You'll build test automation, define QA processes, and work directly with engineers to catch issues before they hit production. Senior candidates will shape our entire QA strategy; mid-level candidates will execute and grow into ownership.

What You'll DoTest AI-Powered Features (35%)

LLM/AI Testing:

• Test AI chat interfaces for response quality, relevance, and safety
• Validate RAG (Retrieval-Augmented Generation) pipelines: correct document retrieval, accurate responses, proper source citation
• Test prompt behavior across edge cases (long inputs, malformed data, adversarial prompts)
• Evaluate AI output consistency and identify failure patterns
• Test function calling / tool use in agentic workflows
• Validate streaming responses render correctly with proper UX

Voice AI Testing (Legal Intake System):

• Test end-to-end call flows: connection, speech recognition, AI responses, call termination
• Validate speech-to-text accuracy across accents, background noise, poor connections
• Test text-to-speech quality and naturalness
• Measure and validate latency requirements (<500ms response time)
• Test barge-in handling (user interrupting AI mid-speech)
• Validate call recording, transcription storage, and retrieval
• Test escalation and human handoff flows

AI Edge Cases:

• Design test cases for non-deterministic AI outputs
• Build evaluation frameworks for AI quality (accuracy, relevance, hallucination detection)
• Test AI behavior under load and with rate limiting
• Validate fallback behavior when AI services fail

Test Core Product Functionality (30%)

Revenue Intelligence Platform:

• Test data ingestion from third-party APIs (QuickBooks, Xero, Shopify, Google Ads, HubSpot)
• Validate data transformation and accuracy in dashboards
• Test multi-tenant data isolation (ensure users only see their data)
• Validate automated alerting triggers and notification delivery
• Test dashboard performance with large datasets
• Validate OAuth flows and credential management

Legal AI Voice System:

• Test call management dashboard functionality
• Validate transcript search, filtering, and annotation features
• Test real-time WebSocket updates during live calls
• Validate agent configuration changes apply correctly
• Test reporting accuracy (conversion rates, call scores)
• Validate compliance features (recording consent, data retention)

Creator Marketplace:

• Test influencer search, filtering, and recommendation accuracy
• Validate campaign workflows end-to-end
• Test payment flows including escrow and milestone releases (Stripe integration)
• Validate CRM functionality and data integrity
• Test both brand and influencer user journeys
• Validate profile data accuracy and media uploads

Build Test Automation (25%)

Automated Testing:

• Build and maintain E2E test suites using Playwright or Cypress
• Create API test automation using Postman/Newman or custom frameworks
• Implement integration tests for critical user flows
• Build regression test suites that run on every deployment
• Create performance tests for latency-sensitive features
• Implement visual regression testing for UI consistency

CI/CD Integration:

• Integrate automated tests into GitHub Actions pipelines
• Configure test environments and test data management
• Set up parallel test execution for faster feedback
• Implement test reporting and failure alerting
• Maintain test reliability (fix flaky tests, optimize execution time)

Test Infrastructure:

• Set up and maintain test environments (staging, QA)
• Create mock services for third-party API testing
• Build test data generators for realistic scenarios
• Implement API mocking for isolated testing

QA Process & Collaboration (10%)

Process:

• Define QA strategies for new features before development starts
• Create and maintain test plans and test case documentation
• Perform exploratory testing to find edge cases automation misses
• Manage bug tracking and prioritization
• Report on quality metrics (bug rates, test coverage, escaped defects)
• Conduct post-mortems on production issues

Collaboration:

• Work with developers during feature development (shift-left testing)
• Participate in code reviews with a QA perspective
• Provide feedback on requirements and designs for testability
• Communicate quality status and risks to stakeholders
• Train team on testing best practices

Required Experience

Core QA Skills (must have):

• 3+ years of QA engineering experience in web applications
• Strong manual testing skills: test case design, exploratory testing, edge case identification
• Experience with test automation frameworks (Playwright, Cypress, or Selenium)
• API testing experience (Postman, REST APIs, understanding of HTTP)
• Experience with SQL for data validation and debugging
• Understanding of CI/CD pipelines and integrating automated tests
• Bug tracking and test management tools (Jira, Linear, or similar)
• Git proficiency (branching, pull requests)

Technical Understanding (must have):

• Solid understanding of web technologies (HTML, CSS, JavaScript, browser dev tools)
• Ability to read and understand code (JavaScript/TypeScript or Python)
• Understanding of REST API architecture and common patterns
• Database querying for test validation (PostgreSQL preferred)
• Experience testing real-time features (WebSockets, live updates)

Soft Skills (must have):

• Strong attention to detail and systematic thinking
• Clear written communication for bug reports and documentation
• Proactive in finding issues, not just validating happy paths
• Ability to work independently and prioritize across multiple products
• Based in Lahore or willing to relocate

Preferred Qualifications

For Senior Consideration:

• 5+ years of QA experience
• Experience building QA processes from scratch or significantly improving existing ones
• Track record of building comprehensive test automation suites
• Experience mentoring junior QA engineers
• Background in leading QA for multiple products simultaneously

AI/ML Testing:

• Experience testing AI/ML-powered features
• Understanding of LLM behavior and common failure modes
• Experience with evaluation frameworks for AI outputs
• Familiarity with prompt testing and adversarial testing

Specialized Testing:

• Experience testing voice/telephony systems (Twilio, VoIP)
• Experience testing payment integrations (Stripe, escrow flows)
• Performance testing experience (k6, JMeter, or similar)
• Security testing basics (OWASP, common vulnerabilities)
• Mobile responsive testing

Technical Depth:

• Experience writing test automation in TypeScript or Python
• API automation beyond Postman (custom frameworks, programmatic testing)
• Database testing and data integrity validation
• Experience with test data management and synthetic data generation
• Contract testing for API integrations

Tech Stack You'll Work With

Applications: React/Next.js frontends, Node.js/Python backends, PostgreSQL, Redis

AI/ML: OpenAI API, Anthropic API, vector databases, RAG pipelines

Voice: Twilio, Deepgram (STT), ElevenLabs (TTS), WebSockets

Payments: Stripe (including Connect and escrow)

Test Tools: Playwright or Cypress (E2E), Postman/Newman (API), Jest (unit), k6 (performance)

Infrastructure: Vercel, AWS, Docker, GitHub Actions

Collaboration: Linear, Slack, Notion, Figma

What You'll Ship

Month 1:

• Understand all three products and their critical user flows
• Set up test automation framework and initial E2E tests for highest-priority flows
• Integrate automated tests into CI/CD pipeline
• Document QA processes and test strategies

Month 2:

• Expand test coverage across all three products
• Build API test automation for backend services
• Implement AI output validation tests
• Create performance benchmarks for latency-sensitive features

Month 3:

• Comprehensive regression suite running on every deployment
• AI/voice testing framework with quality metrics
• QA dashboard showing coverage, pass rates, and quality trends
• Reduced escaped defects and faster release confidence

Interview Process

1. Resume Screen — CV and experience review
2. Initial Call (30 min) — Background discussion, QA philosophy, Q&A
3. Technical Assessment (2-3 hours take-home) — Test plan creation and automation exercise
4. Technical Interview (60 min) — Assessment review, testing scenarios, debugging exercise
5. Founder Chat (30 min) — Final alignment, offer discussion

Total timeline: 3-5 days

How to Apply

Email [email] with subject: "QA Engineer – [Your Name]"

Include:

1. CV/resume (PDF preferred)
2. Brief description of test automation you've built (tools, coverage, impact)
3. Example of a complex bug you found and how you identified it
4. Your notice period and expected salary

Entropy Labs is an equal opportunity employer. We hire based on skill, delivery, and alignment with our values. A university degree is preferred but not required—proven experience matters more.