Sr Test Engineer (AI/ML Systems testing)

About the Role

We are seeking a Senior Test Engineer with expertise in AI/ML systems testing, data validation, and model quality assurance. In this role, you will design and implement strategies to ensure that machine learning models, pipelines, and AI-driven applications meet the highest standards of accuracy, reliability, and fairness.

This position is highly technical, requiring strong experience in testing data-driven workflows, validating ML pipelines, and automating AI-specific test cases. You will collaborate closely with data scientists, ML engineers, and software developers to embed quality checks across the AI lifecycle - from data ingestion to model deployment.

What You'll Do

• Build and maintain automated test frameworks for AI/ML workflows.
• Validate ML models and data pipelines for accuracy, performance, and fairness.
• Design test strategies for training, inference, and drift detection.
• Ensure data quality across ingestion, feature engineering, and post-training.
• Test AI-based APIs and services (NLP, computer vision, generative AI).
• Integrate validation checks into CI/CD and MLOps pipelines.
• Mentor junior QA engineers on AI/ML testing best practices.

What We're Looking

• 8+ years in QA/test automation, with 2+ years in AI/ML testing.
• Strong Python skills (Pytest, Pandas, NumPy).
• Hands-on with ML frameworks (TensorFlow, PyTorch, Scikit-learn).
• Familiarity with MLOps tools (Kubeflow, MLflow, SageMaker).
• Experience testing data pipelines (Airflow, Spark, Glue, Kafka).
• Knowledge of API testing (REST/gRPC).
• Strong grasp of CI/CD for ML systems.

Preferred Qualifications

• Experience testing LLMs or generative AI.
• Familiarity with vector databases (Pinecone, FAISS, Weaviate).
• Knowledge of AI governance and compliance frameworks.

Exposure to data observability tools (Great Expectations, Monte Carlo).

How you'll benefit:

• Attractive Discretionary Time Off
• Private Medical Insurance with optional dependent coverage
• Educational Assistance Reimbursement Program
• Opportunities for reimbursement for conferences, trainings, and other personal development events
• Maternity and Paternity Leave
• Additional benefits and perks will be shared and discussed with you by the recruiter during the interview process.

Note: The purpose of this profile is to provide a general summary of essential responsibilities for the position and is not meant as an exhaustive list. Assignments may differ for individuals within the same role based on business conditions, departmental need or geographic location.