Databricks Data Engineer

Company Description

zRanga is a specialized staffing and talent solutions provider helping enterprises scale quickly with high-quality technology and business professionals. With a team backed by 50+ years of combined industry experience, we connect companies with top-tier talent across CRM, data, cloud, software development, product management, and digital transformation roles.

We deliver fast, reliable, and cost-effective staffing services, from individual experts to full project teams, tailored to each client’s unique needs. Our customer-centric approach has enabled us to support Fortune 100 organizations as well as growing SMEs across multiple industries.

At zRanga, we take pride in providing personalized staffing solutions that drive growth, increase operational efficiency, and set our clients up for long-term success.

Role Description

This is a full-time hybrid role for a Databricks Data Engineer, with the position based in Hyderabad but allowing partial remote work flexibility. The Databricks Data Engineer will be responsible for designing, implementing, and maintaining scalable data solutions using Databricks. Daily tasks include data modeling, building ETL pipelines, managing data warehouses, and developing analytics strategies. The role requires collaboration with cross-functional teams to ensure data solutions are optimized and aligned with business objectives.

Key responsibilities

• Data pipeline development: Design, build, and maintain scalable ETL/ELT pipelines for both batch and streaming data.
• Data architecture and modeling: Design and implement data solutions like data lakes, lakehouses, and data warehouses using Databricks Delta Lake and other components.
• Performance optimization: Optimize Databricks clusters, Spark jobs, and data processing workflows to ensure efficiency and performance.
• Data quality and governance: Ensure data integrity, quality, and security through robust data governance, cleaning, and compliance measures.
• Collaboration: Work with data scientists, analysts, and business stakeholders to understand requirements and deliver high-quality data solutions.
• Integration: Integrate data from various sources, such as APIs, SQL databases, and streaming platforms, into the Databricks environment.
• Programming: Write and optimize code in languages like Python or Scala and SQL for data transformation and automation

Qualifications

• Proficiency in Data Engineering and Data Modeling
• Experience with Extract Transform Load (ETL) processes and tools
• Knowledge of Data Warehousing and managing structured databases
• Strong capabilities in Data Analytics and interpreting data for business insights
• Excellent problem-solving and communication skills
• Experience with Databricks platform and related technologies
• Educational background in Computer Science, Engineering, or a related field
• Familiarity with cloud-based data platforms is a plus

Required skills

• Proficiency in Databricks and Apache Spark.
• Strong programming skills in Python and SQL.
• Experience with ETL/ELT frameworks and data modeling.
• Familiarity with Azure platforms
• Knowledge of data governance and security practices.
• Experience with data pipeline development (batch and streaming).

Job Types: Full-time, Part-time, Contractual / Temporary, Freelance

Pay: From ₹1,614,567.49 per year

Work Location: In person