Senior AI and Automation Tester

About the role

As a Senior AI and Automation Tester, you will make an impact by designing, developing, and testing AI-driven automation solutions that enhance product quality, accelerate delivery, and strengthen system reliability. You will be a valued member of the Technology & Engineering team and work collaboratively with AI engineers, QA automation experts, data teams, and product stakeholders

In this role, you will:

• Build and execute automated test frameworks using Python and Playwright to ensure robustness and scalability of AI-enabled systems.
• Develop and validate AI/ML and Generative AI components, including NLP pipelines, LLM-based applications, and multi-agent architectures.
• Work with LLM frameworks such as LangChain, LangGraph, vector databases, and Retrieval-Augmented Generation (RAG) to support model evaluation and system integration.
• Implement test workflows for multi-agent orchestration, including MCP and A2A protocols.
• Collaborate closely with engineering teams to integrate automation into CI/CD pipelines using GitLab and related DevOps tools.

Work model:

At Cognizant, we strive to provide flexibility wherever possible, and we are here to support a healthy work-life balance though our various wellbeing programs. Based on this role’s business requirements, this is an onsite position requiring 5 days a week in a client or Cognizant office in Weehawken, NJ

The working arrangements for this role are accurate as of the date of posting. This may change based on the project you’re engaged in, as well as business and client requirements. Rest assured; we will always be clear about role expectations.

What you need to have to be considered

• 7+ years of experience in automation engineering, AI testing, or software development.
• Strong programming skills in Python and hands-on experience with Playwright for test automation.
• Applied experience with Generative AI / LLMs, including GPT models, LangGraph, LangChain, Neo4j integrations, vector databases, or similar frameworks.
• Practical experience validating multi-agent systems and orchestration protocols such as MCP or A2A.
• Strong SQL skills and understanding of data modeling techniques.
• Experience working with APIs, RESTful services, and data connectors.
• Understanding of version control systems and CI/CD pipelines (GitLab or similar).

This will help you stand out

Hands-on experience with Azure AI services or other cloud platforms (AWS, GCP).

Familiarity with traditional ML techniques such as clustering, classification, and model evaluation.

Experience testing AI solutions at scale in enterprise environments.

Exposure to MLOps tools, vector search systems, or knowledge graphs.

Strong analytical, problem-solving, and debugging skills.

Cognizant will only consider applicants for this position who are legally authorized to work in the United States without company sponsorship *Please note, this role is not able to offer visa transfer or sponsorship now or in the future*

We're excited to meet people who share our mission and can make an impact in a variety of ways. Don't hesitate to apply, even if you only meet the minimum requirements listed. Think about your transferable experiences and unique skills that make you stand out as someone who can bring new and exciting things to this role.

Salary and Other Compensation:

Applications will be accepted until March 15th, 2026

The annual salary for this position is between $53,477 to 92,500 depending on experience and other qualifications of the successful candidate.

This position is also eligible for Cognizant’s discretionary annual incentive program, based on performance and subject to the terms of Cognizant’s applicable plans.

Benefits: Cognizant offers the following benefits for this position, subject to applicable eligibility requirements:

Medical/Dental/Vision/Life Insurance

Paid holidays plus Paid Time Off

401(k) plan and contributions

Long-term/Short-term Disability

Paid Parental Leave

Employee Stock Purchase Plan

Disclaimer: The salary, other compensation, and benefits information is accurate as of the date of this posting. Cognizant reserves the right to modify this information at any time, subject to applicable law.