Specialist - Quality Engineering

Role description

Sr Python GenAI Tester AWS Stack

Job Summary

Test generative AI solutions on AWS validating LLMs RAG prompts and agentic workflows with n8n and Python libraries like deepchecks and LangChain

Key Requirements 8 Points

1Test LLM outputs on AWS Bedrock using boto3

2Validate finetuned LLMs on AWS SageMaker with deepchecks

3Verify langchain prompts in AWS environments

4Test RAG pipelines with AWS OpenSearch and langchain

5Validate AI agents crewaiautogen on AWS Lambda

6Test n8n agentic workflows eg n8nioworkflows6270

7Ensure deployment stability on Amazon ECSEKS with Docker

8Monitor performance with Amazon CloudWatch and wandb

MustHave Skills

5 years of QA automation 2 years testing GenAILLMs using Python

Expertise in AWS Bedrock SageMaker Lambda boto3

Proficiency in deepchecks langchain crewai autogen wandb

Experience testing n8n workflows RAG prompts

Preferred Skills

AWS certification Machine LearningSolutions Architect

Familiarity with llamaindex n8n templates

Skills

Mandatory Skills : Agentic Framework,AI/Generative AI,Jenkins,User Acceptance Testing,Functional/System Testing,InSprint Testing,Regression Testing,SQL & Database testing,RTM -Testing,Selenium-Java -Testing,SIT -Testing,Test Design and Execution -Testing,Test Reports and Dashboards -Testing

About LTIMindtree
LTIMindtree is a global technology consulting and digital solutions company that enables enterprises across industries to reimagine business models, accelerate innovation, and maximize growth by harnessing digital technologies. As a digital transformation partner to more than 700 clients, LTIMindtree brings extensive domain and technology expertise to help drive superior competitive differentiation, customer experiences, and business outcomes in a converging world. Powered by 83,000+ talented and entrepreneurial professionals across more than 40 countries, LTIMindtree — a Larsen & Toubro Group company — solves the most complex business challenges and delivers transformation at scale. For more information, please visit https://www.ltimindtree.com/. Please also note that neither LTIMindtree nor any of its authorized recruitment agencies/partners charge any candidate registration fee or any other fees from talent (candidates) towards appearing for an interview or securing employment/internship. Candidates shall be solely responsible for verifying the credentials of any agency/consultant that claims to be working with LTIMindtree for recruitment. Please note that anyone who relies on the representations made by fraudulent employment agencies does so at their own risk, and LTIMindtree disclaims any liability in case of loss or damage suffered as a consequence of the same. Recruitment Fraud Alert - https://www.ltimindtree.com/recruitment-fraud-alert/