Data Engineer

Job Title: Data Engineer
Location: Bangalore
Experience Level: 3+ Years
Employment Type: Full-Time

Job Summary

We are seeking an experienced and innovative Lead Data Engineer to drive our data systems and pipelines to the next level. You will play a pivotal role in designing, implementing, and optimizing end-to-end data solutions to support scalable and efficient data-driven decision-making processes. This position is ideal for someone passionate about large-scale data systems, cutting-edge cloud technology, and mentoring a high-performing data engineering team.

Key Responsibilities

Design, develop, and maintain scalable and performant ETL/ELT pipelines and workflows for structured and unstructured data.
Lead the architecture and implementation of data engineering solutions using Python, Airflow, PySpark, and SQL.
Build and manage data pipelines integrating with AWS services such as Athena, S3, EC2, and other cloud-native tools.
Work closely with data scientists, analysts, and cross-functional teams to ensure data quality, availability, and accessibility.
Optimize existing data architectures and query performance on massive data sets for analytical use cases.
Oversee the data governance process with documentation, monitoring, and automation of data workflow processes.
Mentor and guide junior data engineers in best practices, performance optimization, and cutting-edge tools.
Ensure compliance with data security, privacy regulations, and organizational policies.

Key Qualifications

Education: Bachelor’s or Master’s degree in Computer Science, Software Engineering, Data Science, or a related field
Experience: 5+ years of experience in data engineering with at least 1 year of experience as Lead.

Required Technical Skills

Proficiency in Python for data pipeline and systems development.
Strong experience with data orchestration tools, particularly Apache Airflow.
Advanced SQL expertise for data transformation, analysis, and query optimization.
Hands-on experience with PySpark for processing large-scale data.
Expertise in cloud technologies, specifically AWS, including Athena, EC2, S3, and other serverless computing services.

Additional Skills & Tools

Familiarity with big data tools like Hadoop, EMR, or equivalent cloud-supported ecosystems.
Knowledge of modern data warehousing tools and architectures (e.g., Redshift, Snowflake, BigQuery).
Proficiency in CI/CD pipelines and DevOps practices for data engineering.
Experience with monitoring and debugging solutions for data workflows.
Strong problem-solving skills with an ability to work under tight deadlines.

Preferred Attributes

Previous experience in e-commerce, fintech, or related industries.
Leadership or mentoring experience, with the ability to interact and collaborate cross-functional teams.
Strong communication skills with a track record of translating business needs into technical solutions.
Understanding of data security and privacy best practices.

What We Offer
A dynamic and inclusive work environment.
Competitive compensation and benefits package.
Opportunities for continuous learning and professional development.
The chance to work on exciting, large-scale projects leveraging state-of-the-art technologies.

If you’re passionate about building cutting-edge data solutions and enjoy working in a collaborative, fast-paced environment, we’d love to hear from you!

Apply today and become an integral part of our data journey.