software engineer

product engineer

software engineer 1

ai analyst

performance automation engineer Jobs in New York

performance automation engineer

ai evaluations engineer

BMO Financial Group

151 W 42nd Street New York New York,10036
<br>
<div><p><b>About the Team</b></p><p>
BMO&rsquo;s Applied AI team is responsible for building high‑performing, safe, and reliable AI systems that power real banking experiences. The Evaluations group within Applied AI develops the methods, datasets, and tooling that measure quality, safety, and performance across the full AI lifecycle. Working closely with product, engineering, and research partners, the team ensures evaluation signals are deeply embedded into training loops, deployment workflows, and continuous monitoring processes. This group operates at the intersection of data science, machine learning, and responsible AI, enabling scalable, repeatable, and trustworthy evaluation of advanced AI systems.</p><div></div><p><b>
About the Role</b></p><p>
The AI Evaluation Scientist is an individual contributor role focused on delivering the <b>data science stream</b> of AI evaluations. This includes designing, implementing, and productionizing evaluation methods, metrics, and datasets that directly influence modeling decisions, product quality, and the safety posture of AI systems across the bank. You will work hands‑on with complex models&mdash;particularly LLMs and deep learning systems&mdash;developing rigorous empirical analyses that surface model weaknesses, performance trends, and risk signals.</p><p>
In this role, you will translate evaluation standards into robust, maintainable evaluation code and workflows. You will collaborate with engineers to integrate evaluation signals into CI/CD and training pipelines, and work with product and research partners to ensure evaluation insights meaningfully shape model improvements. This position is highly technical, experimental, and delivery‑oriented, with a strong emphasis on applied data science, reproducible experimentation, and responsible AI practices.</p><div></div><p><b>
Key Responsibilities</b></p><ul><li>
Design and implement advanced evaluation methods for LLMs and ML systems, including robustness, reliability, fairness, explainability, calibration, and safety‑and-performance-focused metrics.</li><li>
Build and maintain high‑quality evaluation datasets, golden sets, challenge sets, and red‑teaming corpora tailored to real banking workflows.</li><li>
Develop reusable evaluation harnesses and pipelines that support multi‑agent workflows, tool use, and retrieval‑augmented generation scenarios.</li><li>
Conduct empirical analyses, including statistical tests, error analysis, and ablation studies, to identify model weaknesses and guide model and product improvements.</li><li>
Integrate evaluation metrics and signals into model training loops, deployment gating checks, and continuous monitoring processes.</li><li>
Prototype and validate novel evaluation algorithms inspired by current research in LLM safety, interpretability, and reliability, and convert prototypes into maintainable components.</li><li>
Produce clear, actionable evaluation reports that translate technical findings into insights for engineering, modeling, product, and business stakeholders.</li><li>
Collaborate with engineering, research, and product teams to align evaluation requirements and deliver production‑ready evaluation capabilities.</li><li>
Ensure reproducibility and reliability of evaluation results through dataset versioning, configuration control, testing practices, and documentation.</li></ul><div></div><p><b>
Qualifications</b></p><ul><li>
7+ years of experience in data science, machine learning, or AI development, with at least 3 years focused on evaluation, safety, reliability, or model performance analysis.</li><li>
Master&rsquo;s or PhD in Computer Science, Data Science, Statistics, Engineering, or a related quantitative field, or equivalent practical experience.</li><li>
Strong proficiency in Python and SQL, with experience using PyTorch or TensorFlow, scikit‑learn, and modern data science libraries.</li><li>
Demonstrated experience building evaluation pipelines for LLMs or ML systems, including metric implementation, dataset creation, and CI/CD integration.</li><li>
Solid understanding of statistical testing, calibration, sampling design, and error analysis.</li><li>
Experience with evaluation of RAG systems, tool‑use workflows, long‑context scenarios, adversarial/jailbreak attacks, toxicity/bias detection, or privacy/PII leakage tests.</li><li>
Familiarity with MLOps/LLMOps practices, including experiment tracking, artifact management, and cloud‑based ML infrastructure.</li><li>
Strong communication skills with the ability to translate complex evaluation findings for both technical and non‑technical audiences.</li><li>
Experience with interpretability or fairness techniques (e.g., SHAP, counterfactuals, model probing) is an asset.</li><li>
Contributions to research or open‑source projects in evaluation, safety, reliability, or interpretability are an asset.</li></ul><p></p>
<p><b>Salary:</b></p><p>
$122,400.00 - $228,000.00</p><p><b>
Pay Type:</b></p><p>
Salaried</p><p>
The above represents BMO Financial Group&rsquo;s pay range and type.</p><p>
Salaries will vary based on factors such as location, skills, experience, education, and qualifications for the role, and may include a commission structure. Salaries for part-time roles will be pro-rated based on number of hours regularly worked. For commission roles, the salary listed above represents BMO Financial Group&rsquo;s expected target for the first year in this position.</p><p>
BMO Financial Group&rsquo;s total compensation package will vary based on the pay type of the position and may include performance-based incentives, discretionary bonuses, as well as other perks and rewards. BMO also offers health insurance, tuition reimbursement, accident and life insurance, and retirement savings plans. To view more details of our benefits, please visit: https://jobs.bmo.com/global/en/Total-Rewards</p>
<p><b>About Us</b></p><p>
At BMO we are driven by a shared Purpose: Boldly Grow the Good in business and life. It calls on us to create lasting, positive change for our customers, our communities and our people. By working together, innovating and pushing boundaries, we transform lives and businesses, and power economic growth around the world.</p><p>
As a member of the BMO team you are valued, respected and heard, and you have more ways to grow and make an impact. We strive to help you make an impact from day one &ndash; for yourself and our customers. We&rsquo;ll support you with the tools and resources you need to reach new milestones, as you help our customers reach theirs. From in-depth training and coaching, to manager support and network-building opportunities, we&rsquo;ll help you gain valuable experience, and broaden your skillset.</p><p>
To find out more visit us at https://jobs.bmo.com/us/en
</p><p>BMO is proud to be an equal employment opportunity employer. We evaluate applicants without regard to race, religion, color, national origin, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender identity, gender expression, transgender status, sexual stereotypes, age, status as a protected veteran, status as an individual with a disability, or any other legally protected characteristics. We also consider applicants with criminal histories, consistent with applicable federal, state and local law.</p><p>
BMO is committed to working with and providing reasonable accommodations to individuals with disabilities. If you need a reasonable accommodation because of a disability for any part of the employment process, please send an e-mail to BMOCareers.Support@bmo.com and let us know the nature of your request and your contact information.</p><p>
Note to Recruiters: BMO does not accept unsolicited resumes from any source other than directly from a candidate. Any unsolicited resumes sent to BMO, directly or indirectly, will be considered BMO property. BMO will not pay a fee for any placement resulting from the receipt of an unsolicited resume. A recruiting agency must first have a valid, written and fully executed agency agreement contract for service to submit resumes.</p></div>

AI Evaluations Engineer

NavitasPartners

<div><h1 class="jobSectionHeader"><b>Senior Python Backend&ndash;Heavy Full Stack AI Engineer (LangGraph)</b></h1>
<p><b>
Location -</b> New York City</p>
<h2 class="jobSectionHeader"><b>
Role Overview</b></h2>
<p>
We are seeking a <b>Senior Python Backend&ndash;Heavy Full Stack AI Engineer</b> with hands-on experience in <b>LangGraph and agentic AI systems</b>.</p>
<p>
This role focuses on building production-grade AI agents and workflows on top of enterprise datasets and internal applications. The ideal candidate is execution-focused and capable of delivering immediate impact.</p>
<p></p>
<h2 class="jobSectionHeader"><b>Core Responsibilities</b></h2>
<ul>
<li><p>Build and deploy AI agents using <b>LangGraph</b></p>
</li>
<li><p>Develop backend-heavy AI systems using <b>Python + FastAPI</b></p>
</li>
<li><p>Implement:</p>
<ul>
<li><p>RAG pipelines</p>
</li>
<li><p>Text-to-SQL systems</p>
</li>
<li><p>Prompt-engineered agent workflows</p>
</li>
<li><p>Business data summarization tools</p>
</li>
</ul></li><li><p>Integrate AI capabilities into enterprise applications</p>
</li>
<li><p>Work with structured datasets (PostgreSQL)</p>
</li>
<li><p>Collaborate with business stakeholders</p>
</li>
<li><p>Contribute to frontend updates when required (TypeScript)</p>
</li>
</ul><p></p><h2 class="jobSectionHeader"><b>Required Technical Skills</b></h2>
<h3 class="jobSectionHeader"><b>Backend (Primary Focus)</b></h3>
<ul>
<li><p>Strong Python proficiency</p>
</li>
<li><p>FastAPI experience</p>
</li>
<li><p>Strong SQL skills</p>
</li>
<li><p>PostgreSQL experience</p>
</li>
<li><p>API design &amp; production architecture experience</p>
</li>
</ul><h3 class="jobSectionHeader"><b>AI / Agentic Frameworks (Critical)</b></h3>
<ul>
<li><p>Hands-on <b>LangGraph</b> experience</p>
</li>
<li><p>Strong understanding of:</p>
<ul>
<li><p>Agent orchestration</p>
</li>
<li><p>Prompt engineering</p>
</li>
<li><p>RAG architectures</p>
</li>
<li><p>Text-to-SQL pipelines</p>
</li>
</ul></li><li><p>Experience building production-ready AI agents</p>
</li>
</ul><h3 class="jobSectionHeader"><b>Frontend (Secondary)</b></h3>
<ul>
<li><p>Working knowledge of TypeScript</p>
</li>
<li><p>Ability to support UI changes when required</p></li></ul></div>

Senior Python Backend–Heavy Full Stack AI Engineer - 26-02001

Salesforce

<div><p><i>To get the best candidate experience, please consider applying for a maximum of 3 roles within 12 months to ensure you are not duplicating efforts.
</i></p><p></p><p>Job Category
</p>Software Engineering
<p></p><p>Job Details
</p><p></p><p><b>About Salesforce
</b></p><p>Salesforce is the #1 AI CRM, where humans with agents drive customer success together. Here, ambition meets action. Tech meets trust. And innovation isn&rsquo;t a buzzword &mdash; it&rsquo;s a way of life. The world of work as we know it is changing and we're looking for Trailblazers who are passionate about bettering business and the world through AI, driving innovation, and keeping Salesforce's core values at the heart of it all.
</p><p></p><p>Ready to level-up your career at the company leading workforce transformation in the agentic era? You&rsquo;re in the right place! Agentforce is the future of AI, and you are the future of Salesforce.
</p><p></p><p><b>Job Title: </b>Senior Member of Technical Staff (SMTS) - Site Reliability Engineer (Cloud Automation)
</p><p><b>Location: </b>New York, NY; San Francisco, CA
</p><p></p><p><b>About the Team
</b></p><p><b>The Cloud Platform Engineering </b>team builds and operates the highly available, active-active mission-critical infrastructure that powers Salesforce at scale. We treat the internal cloud as a product designed to maximize developer velocity through automation-first thinking and a strict &quot;No Ticket-Ops&quot; philosophy. We are defining the next generation of platform engineering by running a LEAN, innovative team that leverages AI as much as humanly possible. By integrating AI agents directly into our GitOps workflows and our enterprise WorkOS (Slack), we aim to build a smart, secure platform that our internal developers love.
</p><p></p><p><b>The Shared Team DNA
</b></p><p>While every member of our team has a distinct focus area, we are all &quot;T-shaped&quot; engineers who learn from one another. Regardless of your title, you must share our collective passion for:
</p><ul><li><p>Customer Focus: Treating internal developers as our primary customers and prioritizing their velocity and user experience.
</p></li><li><p>Automation: Eradicating manual toil and &quot;ticket-ops&quot; via GitOps and AI-augmented workflows.
</p></li><li><p>Security: Believing that security should be &quot;shifted left&quot; and built into the code, not bolted on as an afterthought.
</p></li><li><p>SRE Mindset: Engineering for failure, prioritizing self-healing systems, and maintaining a 99.999% availability standard.
</p></li><li><p>Observability: Relying on telemetry, centralized logging, and ChatOps to proactively identify and resolve issues.
</p></li><li><p><b>About the Role
</b></p></li></ul><p>While the Architect determines <i>how </i>our platform should be designed, you are the engineer who actually builds the cloud infrastructure engine. As a Senior SRE focusing on Cloud Automation, you will partner closely with our enterprise CI/CD teams to seamlessly integrate our platform's capabilities into the developer workflow. You are responsible for building the infrastructure vending machines and the enterprise-grade infrastructure-as-code (IaC) modules that abstract away cloud complexity. You will empower internal developers to provision secure, compliant environments in minutes via self-service ChatOps workflows.
</p><p></p><p><b>Your Impact - Responsibilities
</b></p><ul><li><p>The Vending Machine: Build, maintain, and scale the automated provisioning workflows that orchestrate the creation of new, fully governed multi-account cloud environments.
</p></li><li><p>&quot;Golden Modules&quot;: Author, test, and maintain a library of pre-approved Infrastructure-as-Code templates that internal developers will consume. Ensure these modules enforce our strictest standards by default.
</p></li><li><p>Shift-Left Integrations: Partner with the enterprise CI/CD team to plug our platform's automated security scanning, Policy-as-Code evaluations, and cost-estimation checks directly into the developer's Pull Request process.
</p></li><li><p>Resilience &amp; Observability: Implement data-plane-driven automated failover mechanisms, and develop integrations that connect our provisioning tools to our enterprise WorkOS (Slack) for real-time operational intelligence.
</p></li></ul><p></p><p><b>Minimum Qualifications
</b></p><ul><li><p>Bachelor's degree in Computer Science, Computer Engineering, Software Engineering or relevant work experience
</p></li><li><p>7+ years of software engineering or Site Reliability Engineering experience in large-scale cloud environments.
</p></li><li><p>Expert-level proficiency in Infrastructure-as-Code (strictly Terraform) and managing state in highly distributed architectures.
</p></li><li><p>Strong programming skills in Python, Go, or similar languages used for building automation tooling and API integrations.
</p></li><li><p>Proven experience operating multi-region, active-active cloud environments and implementing automated disaster recovery tests.
</p></li><li><p>Deep understanding of GitOps workflows and integrating infrastructure guardrails into existing enterprise CI/CD pipelines.
</p></li></ul><p>*LI-Y
</p><p></p><p>Unleash Your Potential
</p><p>When you join Salesforce, you&rsquo;ll be limitless in all areas of your life. Our benefits and resources support you to find balance and <i>be your best </i>, and our AI agents accelerate your impact so you can <i>do your best </i>. Together, we&rsquo;ll bring the power of Agentforce to organizations of all sizes and deliver amazing experiences that customers love. Apply today to not only shape the future &mdash; but to redefine what&rsquo;s possible &mdash; for yourself, for AI, and the world.
</p><p></p><p>Accommodations
</p><p>If you require assistance due to a disability applying for open positions please submit a request via this Accommodations Request Form .
</p><p></p><p>Posting Statement
</p><p>Salesforce is an equal opportunity employer and maintains a policy of non-discrimination with all employees and applicants for employment. What does that mean exactly? It means that at Salesforce, we believe in equality for all. And we believe we can lead the path to equality in part by creating a workplace that&rsquo;s inclusive, and free from discrimination. Know your rights: workplace discrimination is illegal. Any employee or potential employee will be assessed on the basis of merit, competence and qualifications &ndash; without regard to race, religion, color, national origin, sex, sexual orientation, gender expression or identity, transgender status, age, disability, veteran or marital status, political viewpoint, or other classifications protected by law. This policy applies to current and prospective employees, no matter where they are in their Salesforce employment journey. It also applies to recruiting, hiring, job assignment, compensation, promotion, benefits, training, assessment of job performance, discipline, termination, and everything in between. Recruiting, hiring, and promotion decisions at Salesforce are fair and based on merit. The same goes for compensation, benefits, promotions, transfers, reduction in workforce, recall, training, and education.
</p><p></p>In the United States, compensation offered will be determined by factors such as location, job level, job-related knowledge, skills, and experience. Certain roles may be eligible for incentive compensation, equity, and benefits. Salesforce offers a variety of benefits to help you live well including: time off programs, medical, dental, vision, mental health support, paid parental leave, life and disability insurance, 401(k), and an employee stock purchasing program. More details about company benefits can be found at the following link: https://www.salesforcebenefits.com.Pursuant to the San Francisco Fair Chance Ordinance and the Los Angeles Fair Chance Initiative for Hiring, Salesforce will consider for employment qualified applicants with arrest and conviction records.
<p></p>At Salesforce, we believe in equitable compensation practices that reflect the dynamic nature of labor markets across various regions.&amp;#xa;&amp;#xa;The typical base salary range for this position is $148,500 - $223,900 annually. In select cities within the San Francisco and New York City metropolitan area, the base salary range for this role is $178,900 - $246,000 annually.&amp;#xa;&amp;#xa;The range represents base salary only, and does not include company bonus, incentive for sales roles, equity or benefits, as applicable.</div><p></p>

Software Engineering SMTS - Cloud Reliability

Celonis

<div><div><p>We're Celonis, the global leader in Process Intelligence technology and one of the world's fastest-growing SaaS firms. We believe there is a massive opportunity to unlock productivity by placing AI, data and intelligence at the core of business processes - and for that, we need your help. Care to join us?</p></div><p><b>
Role Description</b></p>
<ul>
<li>As an Applied AI Engineer you are pushing the envelope in solving business-critical problems for our customers. You will be working with our most strategic customers, understanding their objectives and key challenges, and building Celonis solutions using the world's leading Process Intelligence (PI) platform in combination with the largest AI and ML technology partners, such as Microsoft, OpenAI and Databricks. With Celonis' Process Intelligence (PI) platform we feed operational context to AI so it understands our customers' business and enables them to industrialize AI unlocking real ROI on AI deployments and at scale. There is no AI without PI. You will prototype these solutions, demonstrate their value to Executives and ensure successful implementation, adoption and value realization in order to increase the footprint of Celonis at those customers.</li>
</ul>
<p><b>Key Responsibilities:</b></p>
<ul>
<li>AI Discovery &amp; Solutioning: Understand customers AI strategy and business critical challenges. As Celonis product &amp; domain expert, find the best problem-solution fit and translate customer requirements into innovative solutions that move the needle</li>
<li>Hackathons &amp; Prototyping: Think out of the box, have a &bdquo;can-do&quot; attitude and don't shy away from complex problems. Leverage cutting edge AI technologies to rapidly build creative prototypes in customer hackathons solving business critical problems</li>
<li>Agentic Process Transformation: Support our customers in achieving real ROI out of AI deployments at scale enabling a fundamental shift in business operations from traditional, rule-based automation to the use of autonomous AI agents empowered by our Celonis Process Intelligence Platform</li>
<li>Proof projects: End-to-end execution of business-critical Proof-of-Value projects, incl. architecture and deliver secure, scalable LLM/agent systems with RAG, tools, and guardrails; integrating with enterprise data, identity, and compliance frameworks.</li>
<li>Ensure Successful Project Outcome: Applied AI Engineers stay involved with projects until agreed value &amp; adoption thresholds are reached</li>
<li>Specialize in Domains or Industries: To scale knowledge across the organization Applied AI Engineers specialize in domains (e.g. supply chain) and industries</li>
</ul>
<p><b>Requirements:</b></p>
<ul>
<li><b>5+ years of experience leading technical pre-sales</b><b>, including defining AI roadmaps, building compelling ROI/TCO business cases and prototyping of machine learning and generative AI solutions.</b></li>
<li>Understanding of generative AI techniques like RAG, few shot learning, prompt engineering, multi-agent orchestration, multimodal understanding, or fine-tuning that are used to build high-impact use cases like intelligent chatbots and automated text processors.</li>
<li>Understanding of business processes across sectors (such as Supply Chain or Finance) with the ability to translate high-level business needs into specific AI use cases.</li>
<li>Good knowledge of Python and common ML libraries (such as LangChain, pandas, pydantic, sklearn, PyTorch) as well as data engineering tools and technologies.</li>
<li>Strong presentation skills to both internal and external stakeholders (including executives), whether whiteboarding sessions or formal readouts and demos.</li>
<li>Bachelor's Degree required, Masters Degree in computer science, engineering, mathematics or related fields, or equivalent work experience preferred.</li>
</ul>
<p><b>Nice to have (big plus):</b></p>
<ul>
<li>Hands-on experience building agentic systems using LLM orchestration, RAG, function calling, and prompt engineering, while ensuring safety through rigorous evaluations and guardrails.</li>
<li>Working knowledge of tools in the LLM ecosystem such as LangChain, LlamaIndex, or other OSS packages.</li>
<li>Experience in deploying and monitoring models at scale across major cloud platforms (AWS Bedrock, Azure AI, GCP Vertex)</li>
</ul>
<p>Visa sponsorship is not offered for this role.<br>
Learn More about Value Engineering at Celonis Here</p><div><p><b>
What Celonis Can Offer You:</b></p>
<ul>
<li><b>Pioneer Innovation:</b> Work with the leading, award-winning process mining technology, shaping the future of business.</li>
<li><b>Accelerate Your Growth:</b> Benefit from clear career paths, internal mobility, a dedicated learning program, and mentorship opportunities.</li>
<li><b>Receive Exceptional Benefits:</b> Including generous PTO, hybrid working options, company equity (RSUs), comprehensive benefits, extensive parental leave, dedicated volunteer days, and much more. Interns and working students explore your benefits here.</li>
<li><b>Prioritize Your Well-being:</b> Access to resources such as gym subsidies, counseling, and well-being programs.</li>
<li><b>Connect and Belong:</b> Find community and support through dedicated inclusion and belonging programs.</li>
<li><b>Make Meaningful Impact:</b> Be part of a company driven by strong values that guide everything we do: Live for Customer Value, The Best Team Wins, We Own It, and Earth Is Our Future.</li>
<li><b>Collaborate Globally:</b> Join a dynamic, international team of talented individuals.</li>
<li><b>Empowered Environment:</b> Contribute your ideas in an open culture with autonomous teams.</li>
</ul>
<p><b>About Us:</b></p>
<p>
Celonis makes processes work for people, companies and the planet. The Celonis Process Intelligence Platform uses industry-leading process mining and AI technology and augments it with business context to give customers a living digital twin of their business operation. It's system-agnostic and without bias, and provides everyone with a common language for understanding and improving businesses. Celonis enables its customers to continuously realize significant value across the top, bottom, and green line. Celonis is headquartered in Munich, Germany, and New York City, USA, with more than 20 offices worldwide.</p>
<p>
Get familiar with the Celonis Process Intelligence Platform by watching this video.</p><br>
<p><b>
Celonis Inclusion Statement:</b></p>
<p>
At Celonis, we believe our people make us who we are and that &quot;The Best Team Wins&quot;. We know that the best teams are made up of people who bring different perspectives to the table. And when everyone feels included, able to speak up and knows their voice is heard - that's when creativity and innovation happen.</p><br>
<p><b>
Your Privacy:</b></p>
<p>
Any information you submit to Celonis as part of your application will be processed in accordance with Celonis' Accessibility and Candidate Notices</p>
<p>
By submitting this application, you confirm that you agree to the storing and processing of your personal data by Celonis as described in our Privacy Notice for the Application and Hiring Process.</p>
<p>
Please be aware of common job offer scams, impersonators and frauds. Learn more here.</p></div></div>

Senior Applied AI Engineer (Value Engineering) - Life Sciences

Amazon

<div>
 <strong>
  Description
  <br/>
  <br/>
 </strong>
 Amazon is seeking an AI Tutor who has strong language skills, is exceptionally detail-oriented, and has a track record of exhibiting high judgment in ambiguous environments. This role is based in Seattle (HQ1) or New York City (Manhattan) with 5 days in-office presence. Amazon is unable to offer relocation support for this role.
 <br/>
 <br/>
 This is an opportunity to join the high-performing team behind Amazon&rsquo;s generative AI-powered shopping assistant. Rufus makes it easy for customers to find and discover the best products to meet their unique needs by helping with product research, providing comparisons and recommendations, answering specific product questions, and more. This role will bring innovation and cohesion to our efforts to deliver a seamless and delightful AI-assisted shopping experience to customers worldwide.
 <br/>
 <br/>
 We are looking for candidates who are passionate about the intersection of language and technology and are keen to support the training of Large Language Models. This role will be responsible for conducting high-judgment evaluations and labeling data in order to improve the fluency of our Shopping AI model. They will uphold our high standards for style and tone, while using customer feedback to continually iterate and improve the shopping experience.
 <br/>
 <br/>
 This role requires exceptional written and oral communication skills, excellent judgment, strong interpersonal skills, deep curiosity about how things work, and a passion for serving customers. You must enjoy context-switching and multi-tasking while upholding our high standards. This is an opportunity to gain valuable experience in the growing field of artificial intelligence and its application in diverse business settings.
 <br/>
 <br/>
 Key job responsibilities
 <br/>
 <br/>
 <ul>
  <li>
   Deliver high-quality labelled data, using guidelines provided to meet our KPIs and using in-house tools and software, as part of Amazon's commitment to developing and deploying AI responsibly.
  </li>
  <li>
   Demonstrate proficiency in generating high-quality human insight data across a range of modalities, inclusive of text, image, video, and audio.
  </li>
  <li>
   Make sound judgments and logical decisions when faced with ambiguous or incomplete information while performing tasks.
  </li>
  <li>
   Pivot from one category of requirement to another instantaneously, maintaining a keen eye for detail and a high bar for quality.
  </li>
  <li>
   Analyze root causes, identify error patterns, and propose solutions to enhance the quality of labeling tasks and their outputs.
  </li>
  <li>
   Responsible for identifying day-to-day process and operational issues in Standard Operating Procedures and related tooling, suggesting changes to unblock the team.
   <br/>
   <br/>
  </li>
 </ul>
 A day in the life
 <br/>
 <br/>
 You will conduct high-judgment evaluations and deliver high-quality labeled data to train and continuously improve Amazon's Shopping AI model. You will partner closely with Product, Science, and Engineering teams, who are invested in creating solutions that make it easier, faster, and more intuitive for our non-coding workforce to iterate and improve Rufus for customers. You will be part of an Editorial team, which includes creative product and program managers, writers, editors, and language engineers. This is a startup culture: We move fast, have ambitious goals, adapt quickly, and learn along the way.
 <br/>
 <br/>
 <strong>
  Basic Qualifications
  <br/>
  <br/>
 </strong>
 <ul>
  <li>
   Experience in natural language data labeling, data annotation, linguistic annotation or other forms of data markup
  </li>
  <li>
   Bachelor's degree in English, Communications, Linguistics, or a related field
  </li>
  <li>
   Can demonstrate strong attention to safety and ability to follow detailed procedures
  </li>
  <li>
   Experience developing and evaluating data annotation and data quality metrics
  </li>
  <li>
   Previous experience using annotation strategies to contribute to the development and improvement of AI
   <br/>
   <br/>
  </li>
 </ul>
 <strong>
  Preferred Qualifications
  <br/>
  <br/>
 </strong>
 <ul>
  <li>
   2+ years of technical writer, editor, or content strategist experience
  </li>
  <li>
   Experience leading cross-functional teams to deliver products and projects on tight deadlines
  </li>
  <li>
   Experience working in fast paced environments, and managing workload even during times of stress, or escalated activity
  </li>
  <li>
   Experience working with cross-functional teams to deliver products and projects on tight deadlines
   <br/>
   <br/>
  </li>
 </ul>
 Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.
 <br/>
 <br/>
 Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you&rsquo;re applying in isn&rsquo;t listed, please contact your Recruiting Partner.
 <br/>
 <br/>
 The starting pay for this position is listed below. Final starting pay will be based on factors including experience, qualifications, and location. Starting Day 1 of employment, Amazon offers EAP, Mental Health Support, Medical Advice Line, 401(k) matching. Learn more about our benefits at https://hiring.amazon.com/why-amazon/benefits.
 <br/>
 <br/>
 USA, NY, New York - 19.00 - 33.00 USD hourly
 <br/>
 <br/>
 USA, WA, Seattle - 21.00 - 30.00 USD hourly
 <br/>
 <br/>
 <br/>
 <strong>
  Company
 </strong>
 - Amazon.com Services LLC
 <br/>
 <br/>
 Job ID: A3197744
</div>


AI Tutor, Rufus, Amazon Rufus

Eleven Recruiting

<div>
 <p>
  <strong>
   About Eleven Recruiting
  </strong>
 </p>
 <p>
  We are a specialized technology staffing agency supporting professional and financial services companies. Why do we stand out in technology staffing? We listen and act as advisors for our candidates on how they can best add value, find interesting projects, and pave a path for career advancement. We advocate for best pay, diversity in tech, and best job-fit for every candidate we place.
 </p>
 <p>
  <br/>
 </p>
 <p>
  Our client, an investment firm, is seeking a Software Engineer, AI Applications to join their team in New York, NY!
 </p>
 <p>
 </p>
 <p>
  <strong>
   Responsibilities:
  </strong>
 </p>
 <ul>
  <li>
   Integrate LLM-powered features &mdash; including search, summarization, and workflow automation &mdash; into an existing product, working within established codebases and UI patterns.
  </li>
  <li>
   Design a data and metadata layer that makes AI outputs explainable, auditable, and reusable across teams.
  </li>
  <li>
   Set engineering patterns for how AI capabilities are built, tested, evaluated, and maintained going forward.
  </li>
  <li>
   Scope and ship near-term, high-ROI agentic workflows &mdash; such as automated meeting prep briefs, pipeline summaries, and relationship intelligence digests.
  </li>
  <li>
   Build backend services and APIs that synthesize internal data, activity history, and context into client-ready outputs.
  </li>
  <li>
   Take on additional projects and responsibilities as needs evolve across the engagement.
  </li>
 </ul>
 <p>
  <br/>
 </p>
 <p>
  <strong>
   Qualifications:
  </strong>
 </p>
 <ul>
  <li>
   5&ndash;8 years of software engineering experience with a strong backend or fullstack foundation.
  </li>
  <li>
   2+ years of focused experience building and shipping LLM-powered applications to production &mdash; not just prototypes.
  </li>
  <li>
   Solid understanding of how to integrate AI capabilities into existing systems: APIs, data pipelines, and product codebases.
  </li>
  <li>
   Hands-on experience with RAG pipelines, prompt engineering at scale, and LLM evaluation.
  </li>
  <li>
   Pragmatic product sensibility &mdash; able to identify what is worth building, scope it tightly, and ship it.
  </li>
 </ul>
 <p>
  <br/>
 </p>
 <p>
  <strong>
   Preferred:
  </strong>
 </p>
 <ul>
  <li>
   Experience with agent orchestration frameworks such as LangGraph or CrewAI.
  </li>
  <li>
   Domain exposure in financial services &mdash; credit, capital markets, deal workflow, or client coverage.
  </li>
  <li>
   Experience building in regulated environments where auditability and explainability are required.
  </li>
  <li>
   Familiarity with CRM data models or client intelligence tooling.
  </li>
 </ul>
 <p>
  <br/>
 </p>
 <p>
  <strong>
   What This Role Is Not
  </strong>
 </p>
 <p>
  This is not a machine learning research role, and we're not looking for someone whose primary background is model training or data science. The ideal candidate thinks of themselves as a software engineer first &mdash; one who has developed deep expertise in applying LLMs to real product problems.
 </p>
 <p>
 </p>
 <p>
  <strong>
   Pay Rate:
  </strong>
  $80.00-$100.00/hr
 </p>
</div>


Software Engineer - AI Applications

Genpact

<p></p><div><div><div><div><div><b><i>Ready to build the future with AI?</i></b></div></div><div><div><b><i>
At Genpact, we don&rsquo;t just keep up with technology&mdash;we set the pace. AI and digital innovation are redefining industries, and we&rsquo;re leading the charge. Genpact&rsquo;s </i></b><b><i>AI Gigafactory</i></b><b><i>, our industry-first accelerator, is an example of how we&rsquo;re scaling advanced technology solutions to help global enterprises work smarter, grow faster, and transform at scale. From large-scale models to </i></b><b><i>agentic AI</i></b><b><i>, our breakthrough solutions tackle companies&rsquo; most complex challenges.</i></b></div></div><div><div><b><i>
If you thrive in a fast-moving, innovation-driven environment, love building and deploying cutting-edge AI solutions, and want to push the boundaries of what&rsquo;s possible, this is your moment.</i></b></div></div><div><div><b><i>
Genpact (NYSE: G) is an advanced technology services and solutions company that delivers lasting value for leading enterprises globally. Through our deep business knowledge, operational excellence, and cutting-edge solutions &ndash; we help companies across industries get ahead and stay ahead. Powered by curiosity, courage, and innovation, our teams implement data, technology, and AI to create tomorrow, today. Get to know us at </i></b><b><i>genpact.com </i></b><b><i>and on </i></b><b><i>LinkedIn</i></b><b><i>, </i></b><b><i>X</i></b><b><i>, </i></b><b><i>YouTube</i></b><b><i>, and </i></b><b><i>Facebook</i></b><b><i>.</i></b></div></div><div></div><div><div><b><br>
Inviting applications for the role of Senior Engineer - Big Data and Business Intelligence</b></div></div><div></div><div><div><b><br>
Skills &ndash; Headstrong Services LLC seeks Senior Engineer - Big Data and Business Intelligence (multiple positions) in New York NY to analyze petabytes of structured and unstructured data hosted on cloud, flat files, and a variety of databases (traditional, NoSQL, columnar and in-memory) and create technology road map for data integration. Prepare technical </b><b>design</b><b>outlining detailed instructions and logical steps required for coding. Develop, optimize, automate, and maintain software programs, algorithms, and prototypes to handle everyday big data problems. Collect, parse, transform, store, and visualize large sets of data to help end customers unlock the power of data insights and data driven decision-making. Research and recommend software and tools that are pivotal for building impactful data products. Supervise, coach, and mentor junior data engineers. Utilize experience with: Informatica Suite (PowerCenter, Intelligent Cloud Service, and Big Data Management); Amazon Cloud Services (S3, EC2, and EMR); Big Data tools (MapReduce, Spark, or similar); Relational databases (Oracle Exadata); Programming Languages (SQL, PL/SQL); NoSQL Databases (MongoDB or similar); Data </b><b>Visulazation</b><b>tools (Business Objects, Tableau or similar).</b></div></div><div></div><div><div><b><br>
Education &ndash; Position requires a </b><b>Master&rsquo;s</b><b>degree in an Engineering (all), Computer Science, Sciences, Mathematics, or a related field and 2 years of experience in the job offered, a related software engineering, programmer, or systems analyst position, or related occupation. As an alternative, a </b><b>Bachelor&rsquo;s</b><b>degree in an Engineering (all), Computer Science, Sciences, Mathematics, or a related field and 5 years of progressively responsible post-Bachelor's experience in the job offered, a related software engineering, programmer, or systems analyst position, or related occupation is acceptable. Foreign equivalent degrees are acceptable. Position also requires 2 years of experience with the following: Informatica suite (PowerCenter, Intelligent Cloud Services, Big Data Management); Amazon Cloud Services (S3, EC2, EMR); Big Data tools (MapReduce, Spark or similar); Relational Databases (Oracle Exadata); Programming Languages (SQL, PL/SQL); NoSQL Databases (MongoDB or similar); and Data Visualization Tools (Business Objects, Tableau or similar). Position headquartered in New York, NY with placement at project sites nationally within the United States with no additional travel required. $189,592 to $199,071 per year.</b></div></div><div></div><div><div><b><br>
Please send resume and cover letter to:</b></div></div><div></div><div><div><b><br>
Talent.Recruitment@genpact.com</b></div></div><div></div><div><div><b><br>
Indicate job code &ldquo;HSSEBDBINY0326&rdquo; when applying.</b></div></div><div></div><div><div><b><i><br>
Why join Genpact?</i></b></div></div><div><ul><div><div><b><i>
Lead AI-first transformation &ndash; Build and scale AI solutions that redefine industries</i></b></div></div></ul></div></div><div><div><ul><div><div><b><i>
Make an impact &ndash; Drive change for global enterprises and solve business challenges that matter</i></b></div></div></ul></div><div><ul><div><div><b><i>
Accelerate your career&mdash;Gain hands-on experience, world-class training, mentorship, and AI certifications to advance your skills</i></b></div></div></ul></div><div><ul><div><div><b><i>
Grow with the best &ndash; Learn from top engineers, data scientists, and AI experts in a dynamic, fast-moving workplace</i></b></div></div></ul></div><div><ul><div><div><b><i>
Committed to ethical AI &ndash; Work in an environment where governance, transparency, and security are at the core of everything we build</i></b></div></div></ul></div><div><ul><div><div><b><i>
Thrive in a values-driven culture &ndash; Our courage, curiosity, and incisiveness - built on a foundation of integrity and inclusion - allow your ideas to fuel progress</i></b></div></div></ul></div><div><div><b><i>
Come join the 140,000+ coders, tech shapers, and growth makers at Genpact and take your career in the only direction that matters: Up.</i></b></div></div><div><div><b><i>
Let&rsquo;s build tomorrow together.</i></b></div></div><div></div><div><div><b><i><br>
The approximate annual base compensation range for this position is $189,592 to $199,071. The actual offer, reflecting the total compensation package plus benefits, will be determined by </i></b><b><i>a number of</i></b><b><i>factors which include but are not limited to the applicant&rsquo;s experience, knowledge, skills, and abilities; geographic location; and internal equity</i></b></div></div><div></div><div><div><b><i><br>
&ldquo;Los Angeles, California based candidates are not eligible for this role.</i></b></div></div><div></div><div><div><b><i><br>
Genpact is an Equal Opportunity Employer and considers applicants for all positions without regard to race, </i></b><b><i>color</i></b><b><i>, religion or belief, sex, age, national origin, citizenship status, marital status, military/veteran status, genetic information, sexual orientation, gender identity, physical or mental disability or any other characteristic protected by applicable laws. Genpact is committed to creating a dynamic work environment that values respect and integrity, customer focus, and innovation.</i></b><br>
<b><i>Furthermore, please do note that Genpact does not charge fees to process job applications and applicants are not required to pay to participate in our hiring process in any other way. Examples of such scams include purchasing a 'starter kit,' paying to apply, or purchasing equipment or training.</i></b></div></div></div></div><p></p><p><br>
JobPrincipal Consultant</p><p>
Primary LocationUSA-New York</p><p>
ScheduleFull-time</p><p>
Education LevelBachelor's / Graduation / Equivalent</p><p>
Job PostingMar 12, 2026, 7:50:08 AM</p><p>
Unposting DateApr 11, 2026, 1:29:00 PM</p><p>
Master Skills ListConsulting</p><p>
Job CategoryFull Time</p></div>

Senior Engineer - Big Data and Business Intelligence

Explore 358+ Ai evaluations engineer in New York this March. Find roles across top companies and apply now to boost your career.