Automation Tester

Key Skills: GenAI – QA (LangGraph, Azure, ImageRight, Databricks)

Job Location: Hyderabad/Pune/Coimbatore/Bengaluru
Mode of Work: Work From Office

Experience: 3-6 Years

About the job:
We are seeking a QA Engineer to ensure the quality, reliability, and performance of a LangGraph-based AI application deployed on Azure, integrating Databricks and ImageRight systems. This role focuses on validating AI agent logic, LLM outputs, data integrity, and cloud performance through automated testing and CI/CD pipelines.

Know your team:

At ValueMomentum Technology Solution Centers, we are a team of passionate software engineering teams who thrive on tackling complex business challenges with innovative solutions catering to the P&C insurance value chain. We achieve this through a strong software engineering foundation and by continuously refining our processes, methodologies, tools, agile delivery teams, and core engineering archetypes. Our core expertise lies in six key areas: Platforms, Infra/Cloud, Application, Data, Core, and Quality Assurance.

Join our team that invests in your growth. Our Infinity Program empowers you to build your career with role-specific skill development, leveraging immersive learning platforms. You'll have the opportunity to work with some of the best minds serving insurance customers in the US, UK and Canadian markets.

Responsibilities:

• Design and implement automated QA frameworks for LangGraph-based AI workflows.
• Validate AI agent reasoning, LLM responses, and tool integrations (LangChain, custom tools, APIs).
• Conduct end-to-end front-end and API testing for Azure-hosted applications.
• Ensure data integrity and synchronization across Databricks, Azure Storage, and ImageRight.
• Test and optimize cloud scalability, reliability, and performance.
• Create pytest-based automation suites covering functional, regression, and integration testing.
• Integrate automated tests into Azure DevOps CI/CD pipelines.
• Collaborate with developers, data engineers, and MLOps teams to maintain quality across releases.
• Implement evaluation frameworks for AI output (e.g., Ragas, DeepEval, custom metrics).
• Author comprehensive test documentation, reports, and dashboards.

Requirements:

• 3–6 years of experience as a Software or QA Engineer.
• Mastery of QA methodologies — functional, integration, regression, performance, and UAT.
• Strong Python proficiency, especially with pytest and automation frameworks.
• Deep understanding of LangGraph and LangChain concepts (agents, tools, memory, retrievers).
• Experience evaluating LLMs and prompt engineering techniques.
• Familiarity with Azure services (AKS, Blob Storage, Databases, Application Insights, Monitor).
• Skilled with Databricks (notebooks, Delta Lake, SQL/PySpark for data validation and quality checks).
• Experience integrating and testing ImageRight APIs.
• Hands-on experience embedding automation into Azure DevOps pipelines (YAML-based).

Good To Have:
Candidates with these additional skills on their resumes have an added advantage when their profiles are being assessed. Some of them are as follows:

• Knowledge of MLOps or AIOps practices.
• Experience with containerised test environments (Docker/Kubernetes).
• Exposure to LLM observability tools or prompt evaluation dashboards.