Qureos Mentor

Vacatia, Inc.

<div>Join Vacatia and Help Build the Future of AI-Powered Vacation Ownership
Location: Portland, OR (Hybrid &ndash; Three Days In Office) 
Remote considered for exceptional candidates.
About Vacatia 
Vacatia is building the future of vacation ownership. We operate in a fragmented, operationally complex industry where AI has the potential to fundamentally transform how decisions are made, how customers are supported, and how businesses scale.
We're developing AI agents that sit at the center of critical business workflows&mdash;helping owners, supporting operations, surfacing insights, and automating decisions that historically required significant human effort. These agents interact with real customers and influence real business outcomes, making reliability, safety, and performance essential.
We're looking for a hands-on Senior AI Agent &amp; Evals Engineer to own the intelligence layer behind these systems. You'll be responsible for designing agent behavior, building evaluation frameworks, creating guardrails, and continuously improving agent performance as our AI footprint expands across the organization.
If you're passionate about prompt engineering, agent reliability, and creating measurable AI systems that solve meaningful business problems, we'd love to meet you.
Why You'll Love Working at Vacatia
Build the Future of Applied AI 
Design and improve AI agents that directly impact customer experiences, operational efficiency, and business outcomes across our organization.
Work on Problems That Matter 
Your work will influence real-world decisions involving customer communications, mortgage outcomes, rental operations, and owner experiences.
Own the Intelligence Layer 
Take full ownership of prompt design, agent behavior, evaluation systems, guardrails, and continuous performance improvement.
Measure What Matters 
Build sophisticated evaluation frameworks, golden datasets, and automated scoring systems that ensure our agents continually improve.
Partner Across the Business 
Collaborate closely with engineers, operators, and subject matter experts to transform business knowledge into scalable AI systems.
Join a Small Team with Outsized Impact 
Work alongside experienced engineers and leaders who believe AI can create meaningful competitive advantages in a traditionally underserved industry.
Your Impact
<ul><li>Design, refine, and optimize prompts, tool definitions, routing logic, and decision-making behavior across Vacatia's AI agent ecosystem</li>
<li>Build and maintain evaluation frameworks, golden datasets, grading systems, and regression testing pipelines that measure agent quality and reliability</li>
<li>Develop guardrails and safe-failure mechanisms that ensure agents operate responsibly in customer-facing and financially sensitive workflows</li>
<li>Monitor production performance, investigate failures, identify edge cases, and continuously improve agent outcomes through data-driven iteration</li>
<li>Partner with business stakeholders to translate policies, operational requirements, and domain expertise into measurable agent behavior</li>
<li>Collaborate with engineering teams to define context requirements, tool contracts, and integration specifications that support agent success</li>
<li>Create scalable frameworks and reusable patterns for deploying AI agents across new business workflows and use cases</li>
<li>Establish best practices for prompt engineering, evaluation methodologies, observability, and agent operations</li>
</ul>
What You Bring
<ul><li>Proven experience shipping and owning production AI agents or LLM-powered systems beyond proof-of-concept environments</li>
<li>Deep expertise in prompt engineering, including system prompts, tool usage, context management, output constraints, and agent behavior design</li>
<li>Hands-on experience building evaluation frameworks using golden datasets, scoring rubrics, LLM-as-judge methodologies, and regression testing</li>
<li>Strong familiarity with modern AI development tools such as Claude Code, Codex, or similar coding agents</li>
<li>Experience with agent observability and evaluation platforms such as LangSmith, Langfuse, Arize, Galileo, or comparable solutions</li>
<li>Ability to distinguish prompt issues from data, tooling, model, or evaluation failures and systematically improve agent performance</li>
<li>Strong written and verbal communication skills with the ability to work effectively across engineering and business teams</li>
<li>Demonstrated ownership mindset with a passion for building reliable, measurable, and continuously improving AI systems</li>
</ul>
Strongly Preferred
<ul><li>Experience building agents that process communication-based workflows including emails, support tickets, chat interactions, or transcripts</li>
<li>Experience with multiple agent frameworks and a practical understanding of their tradeoffs</li>
<li>Familiarity with the evolving LLM landscape and model selection strategies</li>
<li>Experience designing and implementing end-to-end evaluation pipelines and agent operations workflows</li>
<li>Production experience with online evaluation systems and automated scoring of live traffic</li>
</ul>
Nice to Have
<ul><li>Experience integrating AI systems with Salesforce, AWS Connect, or customer engagement platforms</li>
<li>Background in customer-facing industries where accuracy, compliance, and communication quality are critical</li>
<li>Contributions to open-source projects, technical writing, or public thought leadership in AI, prompt engineering, or agent development</li>
</ul>
Join Us 
Join us at the forefront of applied AI innovation. If you're excited about building intelligent systems that solve complex business problems, improving agent behavior through rigorous evaluation, and helping shape the future of vacation ownership, we'd love to hear from you.
At Vacatia, you'll have the opportunity to build AI solutions that matter, work alongside talented teammates, and create technology that drives real business impact.</div>

Senior AI Agent & Evaluations Engineer

<div>Up to $500 Bonus for New Hires! $250 after 30 days, $250 after 60 days
Now Hiring: Front Desk Associate - AM &amp; PM Shifts | Join Our Resort Team!
Are you passionate about delivering exceptional guest experiences? Do you thrive in a fast-paced, service-driven environment? If so, we&rsquo;d love to meet you!
Vacation Village at Williamsburg is currently seeking Front Desk Associates to join our resort team. As the first point of contact for our guests, you&rsquo;ll play a vital role in creating a warm and welcoming atmosphere while helping ensure smooth front desk operations.
Pay: $16.00/hr
Shifts: 7am - 3:30pm &amp; 2:30pm - 11:00pm
What You'll Do:
<ul><li>Greet every guest with a smile and provide outstanding customer service from check-in to check-out
</li><li>Answer guest inquiries and resolve issues quickly and professionally
</li><li>Manage room assignments, reservations, and billing with accuracy
</li><li>Process payments and handle cash transactions confidently
</li><li>Review reservations and prepare for daily arrivals
</li><li>Maintain front desk procedures, including key control and registration audits
</li><li>Ensure confidentiality and security protocols are followed
</li><li>Collaborate with the team to keep operations running smoothly
</li><li>Take initiative and support various tasks as needed
</li></ul>What We&rsquo;re Looking For:
<ul><li>A friendly, dependable, and customer-focused personality
</li><li>Strong communication and multitasking skills
</li><li>Basic math skills and comfort handling payments
</li><li>Ability to stay organized in a busy environment
</li><li>Tech-savvy with a willingness to learn new systems
</li><li>Detail-oriented and trustworthy with guest information
</li><li>Previous hospitality or customer service experience is a plus
</li><li>Flexibility to work weekends and holidays as needed
</li></ul>Why Join Us?
<ul><li>Work in a welcoming, team-oriented resort environment
</li><li>Opportunities to grow within hospitality and resort operations
</li><li>Be part of creating memorable experiences for our guests every day
</li></ul>Ready to bring your positive energy and customer service skills to our team? 
Apply today and start your next adventure with us!</div>

Front Desk Associate (AM & PM)

Join Vacatia, Inc. and explore 2   exciting career opportunities. They're hiring for various roles with options for remote or on-site work. Apply today and become part of their innovative team.

Vacatia, Inc.

About Company

Senior AI Agent & Evaluations Engineer

Front Desk Associate (AM & PM)