Find The RightJob.
Looking for more job opportunities? Click here!
Job Type: Full Time
Job Category: IT
Job Description
Key responsibilities:
Own day to day operations for agentic and generative AI solutions: maintain and enhance LLM/chatbot agents, refine routing and handoff patterns, and drive regular model re training and calibration cycles.
Partner with ML Engineering to provide L2/L3 production support for AI agents—triage incidents, perform root cause analysis, and implement fixes and hot patches within MLOps guardrails.
Design and implement high quality prompts, agent policies, and tool integrations; optimize intents, guardrails, and safety filters; build offline/online evaluation frameworks (A/B testing, regression suites, human in the loop reviews).
Collaborate with Data Engineering to source, curate, and govern training and evaluation datasets; operationalize SharePoint Snowflake/DataRobot pipelines for repeatable, production grade data flows.
Demonstrated proficiency with LLM orchestration frameworks (e.g., LangChain, LlamaIndex, or similar) and retrieval augmented generation (RAG) patterns.
Build and iterate end to end workflows for generative and agentic AI use cases, including integration with upstream systems, APIs, and downstream channels (web, mobile, contact center, voice).
Experience delivering agentic/RAG, conversational AI, or Voice AI solutions in regulated Financial Services environments, with exposure to customer experience journeys, credit risk/underwriting workflows, or fraud/collections processes.
Exhibit strong attention to detail, ownership, and operational excellence in how AI agents are designed, monitored, and improved over time.
Required Experience: 2 - 3 Years of Experience
Required Skills:
2+ years of experience building production AI/ML applications or agents.
Strong experience with LLM frameworks (langchain/langgraph, or similar) for building agent-based applications.
Strong experience with state management (short-term and long-term memory).
Experience designing and implementing evaluation frameworks for AI applications (LLM-as-judge, deterministic evaluators).
Strong prompt engineering skills with experience in optimization, externalization, and A/B testing.
Experience with vector stores, RAG patterns, and knowledge organization.
Experience with MCP/tool integration, API design, and error handling patterns.
Strong Python and/or TypeScript development skills with production-grade code quality
Nice to have:
Microsoft Copilot Experience.
Solution Engineer/Architect Certifications.
UiPath Experience (RPA and Agentic AI capabilities).
Required Skills
SENIOR EMAIL SECURITY ENGINEER
Similar jobs
No similar jobs found
© 2026 Qureos. All rights reserved.