Director - AI Validation and Monitoring

The Director - AI Validation and Monitoring is the organizational architect of Mayo's policies and processes for measuring, monitoring, and reporting on the real-world effectiveness of AI systems used in clinical practice. As the AI portfolio grows to encompass predictive analytics, generative AI, and agentic AI across clinical and patient experience activities in the Practice, this leader will ensure that every deployed model meets Mayo performance and safety standards and continues to perform as intended — and that performance is defined not just by technical accuracy, but by clinical impact, patient safety, and return on investment. Reporting to the Senior Director, AIA, the Director will build the talent, infrastructure, and culture necessary to make rigorous AI evaluation a continuous organizational capability rather than a one-time validation event.

The Director also designs and operationalizes a pre- and post-deployment performance monitoring and reporting program that tracks model performance across diverse care settings, patient populations, and time horizons — detecting drift, degradation, and disparate impact before they translate into low performance, clinical harm or operational inefficiency. This leader will develop standardized evaluation frameworks that define success metrics for each AI use case in collaboration with clinical, operational, and financial stakeholders, ensuring alignment between technical performance indicators and meaningful outcomes such as patient benefit, patient volume, and clinician burden. The Director will oversee the build-out of dashboards and reporting pipelines that surface AI performance data to AIA and Practice leadership. They will also support structured retrospective reviews when AI-assisted decisions contribute to adverse events or near-misses, working in close partnership with patient safety, quality, and legal teams to drive corrective action and continuous improvement.

Additionally, the Director partners with other AIA components to ensure that performance evaluation supports AIA and Mayo goals for high-performing, transformative clinical care. The Director will be the enterprise nexus for advancing Mayo's leadership in robust yet practical performance and risk evaluation to elevate current standards of care, partnering closely with Practice leaders across departments and sites, as well as other enterprise governance leaders and bodies. Above all, the successful candidate will be a credible, collaborative leader who can work across the boundaries of AI technology, data science, clinical medicine, and operations — translating evaluation findings into the institutional learning that makes AI better and safer for every patient we serve.

Key Responsibilities

• AI Strategy & Program Leadership: Lead development and execution of enterprise AI strategy and multi-year roadmaps aligned with organizational goals.
• Portfolio Oversight: Oversee intake, prioritization, and sequencing of AI initiatives; balance value, feasibility, risk, and capacity across portfolios.
• Cross‑Functional Leadership: Partner with clinical, operational, technical, legal, compliance, and data leaders to advance AI initiatives from concept through deployment.
• Governance & Responsible AI: Ensure AI initiatives adhere to governance frameworks, ethical standards, regulatory requirements, and risk management practices.
• Operational Enablement: Establish operating rhythms, performance metrics, and reporting mechanisms to track progress, outcomes, and value realization.
• Stakeholder Engagement: Serve as a trusted advisor to senior leaders; communicate AI strategy, progress, and impact through executive‑level updates and presentations.
• People & Team Leadership: Lead, develop, and support managers and senior professionals; foster a culture of accountability, collaboration, and continuous improvement.
• Financial & Resource Stewardship: Support budget planning, resource allocation, and business case development for AI initiatives.

Core Competencies

• Enterprise AI & Digital Strategy
• Executive Presence & Influence
• Change Leadership & Resilience
• Ethical & Responsible AI Stewardship
• Cross‑Functional Collaboration
• Program & Portfolio Management

This is a hybrid position and incumbent must live within 100 miles of a Mayo Clinic campus. Fulltime remote may be considered.

Mayo Clinic will not sponsor or transfer visas for this position including F1 OPT STEM.

Position Qualifications

• Bachelor’s degree and 10 years of progressive experience in healthcare, technology, operations, analytics, or related fields with demonstrated leadership responsibility required.
• Master’s degree and 10 years of progressive experience in healthcare, technology, operations, analytics, or related fields with demonstrated leadership responsibility preferred.
• Demonstrated experience leading high performing teams and delivering complex enterprise initiatives in a matrixed organizations preferred.