Senior Cloud Engineer

Senior Cloud Engineer – Azure Data & AI Platform

Role Overview

We are seeking a Senior Cloud Engineer to design, implement, and manage the Azure infrastructure powering our Data & AI platform, with a focus on Azure Databricks, ADLS Gen2, Azure Data Factory, and Azure Machine Learning.

The role owns IaC, networking, security, identity, governance, observability, CI/CD, and cost optimization, while serving as the technical partner to Data Engineering, Data Science, and Databricks teams.

Key Responsibilities

• Build and manage Azure infrastructure using Terraform and reusable IaC modules.
• Design secure Azure networking and identity architecture, including VNets, private endpoints, NSGs, RBAC, Managed Identities, and Key Vault.
• Manage ADLS Gen2 architecture, access controls, lifecycle, encryption, and storage optimization.
• Administer Azure Databricks, including workspaces, Unity Catalog, cluster policies, identity federation, and multi-workspace strategy.
• Implement monitoring and observability using Azure Monitor, Log Analytics, diagnostics, and alerting.
• Own CI/CD and environment management across development, testing, and production.
• Drive FinOps, cost visibility, DBU optimization, tagging, budgeting, and capacity planning.
• Develop platform automation using Python, PowerShell, and/or Bash.
• Troubleshoot cross-platform issues involving infrastructure, Databricks, networking, permissions, and workloads.
• Establish platform standards, reference architectures, and self-service patterns for engineering teams.

Mandatory Skills

• Expert-level Terraform and production-grade IaC/CI/CD experience.
• Hands-on Azure Databricks Administration and Unity Catalog.
• Strong Azure Networking & Security expertise.
• Strong ADLS Gen2 enterprise architecture experience.
• Azure Data Factory platform/infrastructure experience.
• Entra ID, RBAC, Managed Identities, Key Vault.
• Strong Python and scripting skills.
• Working knowledge of Spark and SQL for troubleshooting and performance diagnostics.
• Strong stakeholder management and technical leadership skills.

Good to Have

• Databricks Asset Bundles and Terraform Databricks Provider.
• Azure Machine Learning / MLflow.
• Kubernetes / AKS.
• Policy-as-Code: Azure Policy, OPA, Sentinel, Checkov.
• Event Hubs, Kafka, or Stream Analytics.
• FinOps experience.
• Multi-region / multi-tenant Databricks environments.
• Relevant Databricks, Azure, and Terraform certifications.

Pay: ₹120,000.00 - ₹150,000.00 per month

Benefits:

• Work from home

Application Question(s):

• Are you willing to share PAN/Aadhar for the background verification (BGV) process ?
• Are you currently employed anywhere? If so, How will you manage this new opportunity?
• Would you be comfortable working from the *Trivandrum/Kochi office for the first week, after which the role will be fully remote, with travel and accommodation expenses covered by the company* for the first week?
• Client would require UAN for interview process once profile gets shortlisted. Are you fine with that?
• Are you fine with 3:30 PM IST to 11:30 PM IST Shift timing?
• This is a CONTRACTUAL JOB for 6 MONTHS currently. Are you comfortable with it?

Experience:

• Azure: 4 years (Required)
• Terraform: 3 years (Required)

Work Location: Remote