AI/ML Engineer – Azure Databricks

AI/ML Engineer – Azure Databricks

Work Mode: Remote (1–2 days/month )
Shift Timing: 11:00 AM – 9:00 PM IST
Experience: 5+ Years

Job Summary

We are seeking an experienced AI/ML Engineer with strong expertise in Azure Databricks, Python, PySpark, and SQL to design, develop, and deploy scalable machine learning and data engineering solutions. The candidate will work closely with data scientists, architects, and business stakeholders to deliver production-ready AI/ML solutions on Microsoft Azure.

Key Responsibilities

• Design, develop, and maintain end-to-end AI/ML solutions using Azure Databricks
• Build and optimize data pipelines using PySpark and Spark SQL
• Develop, train, evaluate, and deploy ML models in production
• Perform feature engineering, preprocessing, and hyperparameter tuning
• Implement scalable batch and streaming data solutions
• Optimize Spark jobs for performance, cost, and reliability
• Collaborate with data scientists to productionize models
• Monitor model performance and detect data drift
• Maintain documentation for technical designs and workflows
• Follow best practices in testing, CI/CD, and version control

Required Skills & Qualifications

• 5+ years of experience in AI/ML or Data Engineering roles
• Strong proficiency in Python
• Extensive hands-on experience with Azure Databricks
• Strong expertise in PySpark and Spark SQL
• Advanced SQL skills for data transformation and analysis
• Experience building ML models (Regression, Classification, Clustering, etc.)
• Familiarity with ML libraries such as:
• Scikit-learn
• MLflow
• TensorFlow
• PyTorch
• Experience working with Azure services such as:
• Azure Data Lake Storage
• Azure Synapse Analytics
• Azure Machine Learning (Preferred)
• Strong understanding of ETL/ELT concepts and big data architectures
• Experience with Git and collaborative workflows
• Strong analytical and communication skills

Preferred / Nice-to-Have Skills

• Experience with streaming technologies such as:
• Apache Kafka
• Azure Event Hubs
• Knowledge of MLOps practices and CI/CD pipelines
• Experience with Delta Lake and data versioning
• Exposure to containerization (Docker)
• Understanding of Azure security and governance
• Domain experience in Finance, Healthcare, Retail, or Telecom (Optional)

Job Type: Contractual / Temporary
Contract length: 6-12 months

Pay: ₹60,000.00 - ₹80,000.00 per month

Experience:

• Python: 3 years (Required)

Work Location: Remote