Lead Data Engineer (SQL Server, DevOps, Python & AI)

We are seeking an experienced Lead Data Engineer to design, develop, and optimize scalable data platforms while driving AI-powered innovation. This role combines hands-on technical expertise with leadership responsibilities, mentoring a team of data engineers and collaborating with cross-functional teams to shape the future of data-driven IT asset management.

What You’ll Do

Design and optimize SQL Server architectures with performance tuning & high availability

Build and manage ETL pipelines and scalable data workflows

Implement DevOps practices for database CI/CD workflows

Lead Python-based data applications for processing, analytics & AI model deployment

Collaborate with data scientists & engineers to deliver AI-driven solutions

Ensure data governance, security & compliance standards are met

Explore & recommend new data technologies for continuous innovation

What We’re Looking For (Qualifications)

Bachelor’s/Master’s in Computer Science, Engineering, or related field

10+ years in data engineering/database development & 2+ years in leadership

Strong expertise in SQL Server (tuning, optimization, high availability)

7+ years of Python experience (Pandas, NumPy, PySpark, SQLAlchemy)

Hands-on with DevOps (Azure DevOps, GitHub Actions), Docker, Kubernetes

Familiar with real-time data processing (Kafka, Spark Streaming)

Knowledge of data modeling, warehouses & cloud (Azure preferred)

Exposure to AI/ML frameworks (TensorFlow, PyTorch, scikit-learn) & MLOps tools

Experience with web scraping (Beautiful Soup, Scrapy, Selenium)

Strong leadership, problem-solving, and excellent communication skills

Interested? Share your resume at:

seenas@theknowledgeartisans.com

meghnaj@theknowledgeartisans.com

Job Type: Full-time

Work Location: Remote