About the Role
As a Machine Learning SQA Engineer, you will design and execute test automation and validation systems that ensure the reliability, accuracy, and consistency of AI and ML-based applications. You’ll help bridge classic software QA principles with emerging AI quality challenges — validating large language model (LLM) outputs, data pipelines, and AI-driven APIs.
This role is ideal for a QA engineer with strong automation skills and growing experience in AI or data-centric systems, who is eager to apply proven testing discipline to next-generation intelligent products.
Key Responsibilities
- Develop, maintain, and execute automated and manual test cases for AI/ML systems, APIs, and data pipelines.
- Build and enhance test automation frameworks to validate LLM or ML model outputs and integrations.
- Test AI agent workflows and monitor system performance, reliability, and output consistency.
- Collaborate with engineers and data scientists to diagnose, document, and track defects.
- Evaluate LLM and prompt behavior against predefined benchmarks and edge cases.
- Participate in code reviews and provide feedback on testability and quality standards.
- Contribute to continuous integration and delivery (CI/CD) testing processes and pipelines.
- Maintain test documentation, datasets, and metrics to track system health and quality trends.
- Research and propose new QA methodologies for AI and ML systems (“AI testing AI”).
Required Skills & Experience
- 3–5 years of experience as an SQA, Test Automation, or QA Engineer (preferably with exposure to data or ML systems).
- Proficiency in Python and one or more of: JavaScript, Java, or TypeScript for automation scripting.
- Strong understanding of software testing principles, test case design, and defect lifecycle management.
- Experience building or maintaining test automation frameworks (e.g., PyTest, Cypress, Selenium, Playwright).
- Working knowledge of SQL and structured data validation.
- Familiarity with ML/LLM fundamentals and evaluating model outputs.
- Experience testing RESTful APIs and using tools such as Postman or pytest-requests.
- Exposure to cloud environments (AWS, GCP, or Azure) and CI/CD pipelines (e.g., GitHub Actions, Jenkins).
Preferred Attributes
- Curiosity to learn emerging AI technologies and apply traditional QA methods to new paradigms.
- Analytical mindset with strong systems thinking — able to understand and test full workflows.
- Ability to visualize and communicate complex test scenarios.
- Comfort working in dynamic, iterative environments where experimentation drives improvement.
Your growth and well-being:
At Align, every smile matters. We’re committed to helping you thrive by supporting the health, growth, and well-being of our team members through a variety of tools and programs. While specific offerings may vary by location and role, Align employees can typically expect:
- Health and well-being programs to keep you thriving in both body and mind.
- Employee-exclusive discounts on Invisalign products.
- Learning opportunities through online learning resources and support for your individual development plans.
- Inclusive, global workplace that fosters collaboration, recognition and belonging.
Country and/or role specific details will be shared with you by your recruiter during the interview process.
Discover Align:
We are a global community of game-changers and smart team players, united by our belief in the power of a smile. Our dynamic team of exceptional employees is dedicated to transforming the industry and creating extraordinary outcomes every day.
Align’s core values of agility, customer, and accountability are more than words to work by, they are words we live by. The actions we take every day speak to who we are as a company and our focus on being truly impactful. We celebrate our differences, and the many ways we support one another— ultimately creating a more inclusive organization and world as we continue transforming smiles and changing lives.
We foster a culture where thinking differently and seeking new experiences are not just encouraged but celebrated. With the Align Mindset, we empower each other, ensuring every voice is heard and valued in an inclusive environment that inspires creativity and collaboration.
At Align, we believe in the power of a smile, and we know that every smile is as unique as our employees. As we grow, we are committed to building a workforce rich in diverse cultural backgrounds and life experiences, fostering a culture of open-mindedness and compassion. We live our company values by promoting healthy people and healthy communities, all with the intent of changing millions of lives, one unique smile at a time.
As part of our commitment to innovation, Align Technology includes exocad and Cubicure, companies that enhance our offerings and extend our impact to industry transformation.
Eager to learn how we embrace our global differences and nurture employee well-being?
Explore Align's culture here!
Want to discover more about exocad and Cubicure? Click on their names for additional information.
Applicant Privacy Policy:
Review our Applicant Privacy Policy for additional information.
Equal Opportunity Statement:
Align Technology is an equal opportunity employer. We are committed to providing equal employment opportunities in all our practices, without regard to race, color, religion, sex, national origin, ancestry, marital status, protected veteran status, age, disability, sexual orientation, gender identity or expression, or any other legally protected category. Applicants must be legally authorized to work in the country for which they are applying, and employment eligibility will be verified as a condition of hire.