Role Overview:
Join as a part-time Data DevOps & DevSecOps Engineer focused on PowerBI, Azure Synapse, and Data Factory for a US-based client. This remote role requires expertise in cloud data automation, security-focused deployments, and data pipeline orchestration distinct from traditional software devops.
Key Responsibilities:
- Architect, build, and automate ETL/ELT data pipelines using Azure Data Factory and Synapse (PySpark, SparkSQL).
- Manage CI/CD pipelines and version control with Azure DevOps and Git for data assets including ARM templates, notebooks, and SQL scripts.
- Develop and maintain Infrastructure as Code (IaC) deployments of data platform resources such as Synapse workspaces, Key Vault, storage accounts, and Event Hub.
- Apply DevSecOps practices to automate testing (unit, schema, data quality via tools like Great Expectations), deployment, monitoring, and alerting.
- Create dashboards and reporting solutions with PowerBI and Synapse monitoring tools.
- Collaborate with analytics, BI, and business teams to ensure data governance, validation, and lineage documentation.
- Work flexible hours to support US time zone (9 AM–12 PM EST) while located in India.
Required Skills and Experience:
- 5+ years in data engineering or cloud ETL development, especially with Azure Synapse and Data Factory.
- Strong knowledge of DevOps CI/CD pipelines and source control with Git/Azure Repos.
- Hands-on experience with PySpark, SparkSQL, SQL Server, and PowerBI.
- Expertise in Infrastructure as Code (IaC) for building and scaling data platforms.
- Good understanding of data warehousing concepts (star/snowflake schemas) and performance tuning.
- Familiarity with API integrations and data ingestion from various sources.
- Solid scripting skills in Python or PowerShell for automation and testing.
TechnologyStack
Azure Synapse | Azure Data Factory | PySpark | SparkSQL | Git | Azure DevOps Pipelines | SQL Server | PowerBI | Azure Monitor | Great Expectations (or similar) | Infrastructure as Code (IaC)
Position Details
- Location: Remote (India)
- Hours: Part-Time (After hours IST / 9 AM – 12 PM EST US)
- Client: USA based direct client
- Employment Type: Part-time contract
Job Types: Part-time, Contractual / Temporary, Freelance
Contract length: 6 months
Pay: ₹80,000.00 - ₹150,000.00 per month
Expected hours: 15 – 20 per week
Application Question(s):
- Email and Phone number if not mentioned in resume
Experience:
- DevOps: 6 years (Preferred)
- Azure: 5 years (Preferred)
Work Location: Remote