Databrick Engineer

As a Databricks Engineer, you will be responsible for designing, developing, and maintaining data pipelines and solutions on the Databricks platform. You will work closely with data scientists, analysts, and other engineers to build scalable and efficient data infrastructure. Your primary focus will be on ensuring data quality, performance, and reliability. Responsibilities:

• Design, develop, and maintain data pipelines using Databricks, Spark, and other relevant technologies.
• Implement data ingestion, transformation, and loading processes.
• Optimize data processing performance and efficiency.
• Monitor and troubleshoot data pipelines and infrastructure.
• Collaborate with data scientists and analysts to understand data requirements and provide solutions.
• Ensure data quality, security, and compliance.
• Automate data-related tasks and processes.
• Stay up-to-date with the latest Databricks features and best practices.
• Participate in code reviews and contribute to the team's knowledge sharing.