Lead Data Engineer

About the Role

We are seeking a Lead Data Engineer to join our team. In this role, you will be crucial in designing, building, and maintaining our data infrastructure. This is a hands-on position requiring a strong foundation in data warehousing, ETL processes, and database management. The ideal candidate will have a keen eye for detail and the ability to work collaboratively to support business intelligence and analytics initiatives.

Key Responsibilities

• Design, develop, and maintain efficient ETL/ELT data pipelines using tools such as SSIS, ADF, Talend, DBT, Informatica, DataStage, or Ab Initio.
• Work extensively with relational databases like Oracle, SQL Server, and Snowflake, using your expertise in SQL for complex querying and performance optimization.
• Implement and manage data ingestion using Snowpipe.
• Utilize Python for data preprocessing and building data models, leveraging libraries like NumPy and Pandas.
• Collaborate with various teams to ensure data quality and accessibility.
• Work within cloud environments such as AWS or Azure.
• Create and maintain thorough documentation for all data processes and systems.

Required Qualifications

• 6-8 years of experience in a data engineering or similar role.
• Expertise in SQL and hands-on experience with Oracle, SQL Server, and Snowflake.
• Strong understanding of ETL and Data Warehousing principles.
• Experience with one or more ETL tools from the following: SSIS, ADF, Talend, DBT, Informatica, DataStage, or Ab Initio.
• Proficiency in Python for data manipulation, including Numpy and Pandas.
• Experience with Snowpipe.
• Experience working in a cloud environment (AWS or Azure).
• Strong documentation and listing skills.

Preferred Qualifications

• Proficiency in any modern BI tool is a plus.

Job Type: Full-time

Pay: Up to ₹1,500,000.00 per year

Experience:

• Python: 6 years (Required)
• ETL and Data ware Housing: 5 years (Required)
• any cloud (AWS or Azure): 5 years (Required)
• Snowpipe and modern BI tools: 5 years (Required)

Work Location: Remote