Databricks lead developer

a. Design, develop, and deploy end-to-end data engineering solutions on the Databricks platform.

b. Build scalable, reliable, and optimized data pipelines that support large-scale analytics, machine learning, and real-time data processing.

c. Utilize Databricks to integrate, transform, and analyze big data from various sources.

2. Team Leadership and Mentorship:

a. Lead and mentor a team of data engineers and developers in the creation of high-performing data systems.

b. Provide technical direction, guidance, and feedback to junior developers and data engineers.

c. Foster a collaborative environment within the team to encourage learning and knowledge sharing

3. Architecture & Solution Design:

a. Design data architectures that support the business's data needs, ensuring the scalability and flexibility of data systems

b. Work closely with data scientists, data analysts, and business analysts to understand requirements and create solutions that align with organizational goals

c. Develop data models, workflows, and frameworks for seamless data integration

4. Cloud Infrastructure Management:

a. Manage the Databricks environment in a cloud platform (AWS, Azure, or GCP), ensuring efficient provisioning, performance optimization, and cost management.

b. Work with cloud teams to manage cloud resources, including storage, compute, and networking

5. Collaboration with Stakeholders:

a. Collaborate with business leaders, product teams, and other stakeholders to define and prioritize data engineering initiatives

b. Translate business requirements into technical solutions, ensuring that data needs are met effectively and efficiently

6.