Senior Data Engineer with Data Bricks

About the Role

Mandatory Skills
Databricks Engineer, Power Bi Developer, Dax Queries, SQL, Data Warehousing, Power Automate

Skill to Evaluate
Databricks Engineer, Power Bi Developer, Dax Queries, SQL, Data Warehousing, Power Automate

Experience
5 to 9 Years
Key Responsibilities:

• Design and implement scalable data processing solutions using Databricks, including ETL processes that efficiently handle large data volumes.
• Develop interactive dashboards and reports using Power BI to facilitate real-time data visualization and insights for stakeholders.
• Collaborate with cross-functional teams to understand data requirements and deliver solutions that meet business needs and objectives.
• Optimize data storage and retrieval processes to enhance performance and reduce latency.
• Ensure data quality and integrity by implementing best practices for data governance and validation.
• Mentor junior data engineers and contribute to knowledge sharing within the team.
• Stay updated with the latest trends and technologies in data engineering, and evaluate their applicability to the organization's needs.

Skills and Tools Required:

• Proficiency in Databricks and experience with Spark for big data processing.
• Strong experience with Power BI, particularly in building reports and dashboards using DAX.
• Solid programming skills in Python or Scala for developing data pipelines.
• Knowledge of SQL and experience with relational databases and data warehousing concepts.

- Familiarity with cloud platforms - Azure, particularly in relation to data storage and processing.

• Understanding of data modeling, ETL processes, and data integration methodologies.
• Excellent problem-solving skills and attention to detail.
• Strong communication and collaboration abilities to work effectively in a team-oriented environment.

Skill Area Tools & Technologies
Data Engineering Databricks, Apache Spark, Delta Lake
Programming Python, SQL, PySpark
BI & Visualization Power BI, DAX, Power Query
Cloud Platforms Azure
DevOps & CI/CD Git, Azure DevOps
Data Governance Unity Catalog, Data Lake Security

Preferred Qualifications:

• Bachelor's or Master's degree in Computer Science, Data Science, Information Technology, or a related field.
• Previous experience in a similar data engineering role, particularly within a corporate environment.
• Knowledge of additional BI tools and data visualization platforms is a plus.

Requirements

About the Company