Azure Data Engineer

Job Summary: We are seeking a skilled and experienced Cloud Data Engineer to join our dynamic team. The ideal candidate will be responsible for designing, implementing, and maintaining data solutions on the Azure/AWS cloud platforms. The candidate should have a strong background in data engineering, including ETL processes, data warehousing, and database management. The role requires expertise in Databricks other relevant technologies. The Data Engineer will collaborate with cross-functional teams to ensure the successful delivery of scalable and efficient data solutions.

Minimum 3-5 Years of Experience in Data Integration platform on cloud (Azure preferred)

Responsibilities:

• Solution Design and Architecture:
• Collaborate with stakeholders to understand business requirements and design scalable data solutions on the cloud platforms.
• Create and maintain data architecture diagrams and documentation.
• Data Ingestion and ETL:
• Develop and implement ETL processes using Databricks, and other relevant tools.
• Design and optimize data pipelines to ensure efficient data processing and transformation.
• Data Storage and Management:
• Implement and manage Relational Databases, Snowflake and other data sources.
• Ensure data integrity, security, and compliance with industry best practices and organizational standards.
• Data Transformation and Processing:
• Utilize Databricks and other tools for data transformation and processing.
• Optimize queries and data processing workflows for performance and efficiency.
• Monitoring and Optimization:
• Implement monitoring solutions to track the performance and health of data solutions.
• Identify and resolve performance bottlenecks and optimize data processing workflows.
• Collaboration and Communication:
• Collaborate with cross-functional teams, including data scientists, analysts, and business stakeholders.
• Communicate effectively with technical and non-technical audiences, providing insights and recommendations.
• Automation and Scripting:
• Develop scripts and automation processes to streamline data engineering tasks.

Qualifications:

• Bachelor’s degree in Computer Science, Information Technology, or a related field.
• Proven experience as a Data Engineer with Azure/AWS cloud technologies.
• In-depth knowledge of Databricks, and other relevant Azure services.
• Strong proficiency in SQL, Python, and/or other scripting languages.
• Experience with data modeling, schema design, and database performance tuning.
• Familiarity with data warehousing concepts and best practices.
• Excellent problem-solving and analytical skills.
• Effective communication and collaboration skills.

If you meet these qualifications and are excited about the opportunity to work with cutting-edge cloud technologies to solve complex data challenges, we encourage you to apply. Join our team and be a key contributor to the success of our data-driven initiatives.