Spark, Scala, Azure Synapse

Key skills: Azure SQL, AZURE Synapse, Spark

Experience: 6 to 13 years

Location: Bhubaneswar

Job Description:

• Solution Design and Development:
  • Collaborate with business stakeholders and data architects to understand data requirements and design scalable and efficient solutions using Azure Synapse Analytics.
  • Develop and implement data pipelines, data warehouses, and ETL processes to integrate data from various sources into Azure Synapse Analytics.
• Query Optimization:
  • Optimize SQL queries and data processing workflows to ensure optimal performance and responsiveness of Azure Synapse Analytics.
• Integration:
  • Integrate Azure Synapse Analytics with other Azure services, such as Azure Data Factory, Azure Databricks, and Power BI, to create end-to-end data solutions.
• Monitoring and Troubleshooting:
  • Implement monitoring solutions to track system performance, data quality, and job completion status. Troubleshoot and resolve issues promptly.
• Security and Compliance:
  • Implement and enforce security measures to protect sensitive data. Ensure compliance with data governance and regulatory requirements.
• Documentation:
  • Create and maintain comprehensive documentation for all developed solutions, including data models, ETL processes, and system configurations.
• Collaboration:
  • Collaborate with cross-functional teams, including data scientists, analysts, and business users, to understand their requirements and deliver effective solutions.
• Continuous Learning:
  • Stay updated on the latest Azure Synapse Analytics features and best practices. Continuously enhance skills and knowledge to drive innovation and improvement.