Senior Azure AI Infrastructure Architect

Role Overview

AceNet is seeking a Senior Azure AI Infrastructure Architect to lead the design, governance, security, and operationalization of AI infrastructure on Microsoft Azure.

Operating within a centralized Cloud Center of Excellence (CoE), this role will act as the enterprise platform authority for Azure AI services. The architect will partner closely with application teams, data scientists, security, networking, and operations teams to provision, secure, optimize, and transition AI solutions into production at scale.

This is a senior-level role requiring deep Azure expertise, strong governance orientation, and the ability to enable AI innovation within a controlled, secure enterprise framework.

Key Responsibilities

• Design and maintain enterprise-grade Azure AI resources.
• Architect infrastructure for Azure OpenAI, Azure Machine Learning, Azure AI Services, GPU-based compute environments, and AKS for AI workloads.
• Define subscription strategy, resource group structure, tagging standards, and naming conventions aligned with CoE governance.
• Design secure networking architectures including VNET segmentation, Private Endpoints, Firewall, and NSGs.
• Continuously monitor and improve security posture using Microsoft Defender for Cloud and related tools.
• Implement least-privilege RBAC models and ensure secure identity integration.
• Enforce governance controls using Azure Policy and Management Groups.
• Review AI solution architectures and participate in architecture review boards.
• Monitor and optimize AI workload costs using Azure Cost Management and FinOps practices.
• Implement Infrastructure as Code using Terraform (preferred), Bicep, or ARM templates.
• Support CI/CD pipelines and controlled change and release management processes.
• Develop operational runbooks and ensure smooth transition of AI services to operations teams.
• Act as the primary AI infrastructure advisor within the Cloud CoE and guide stakeholders on best practices.

Required Skills & Experience

• Deep hands-on expertise in Microsoft Azure and Azure AI services.
• Strong experience designing AI landing zones and enterprise cloud architectures.
• Advanced knowledge of Azure networking (VNETs, Private Link, Hybrid connectivity).
• Strong expertise in Azure RBAC, Entra ID, Managed Identities, Azure Policy, and Key Vault.
• Experience with Microsoft Defender for Cloud and enterprise security monitoring.
• Hands-on experience with Infrastructure as Code and CI/CD pipelines.
• Strong FinOps mindset and experience managing Azure cost optimization.
• 10+ years in IT infrastructure/cloud architecture.
• 5+ years of hands-on Azure architecture experience.
• Experience operating within a centralized Cloud CoE model.

Job Type: Full-time