Lead Data Engineer

• Job Description
  Looking for a highly skilled and experienced Lead Data Engineer to join our growing Data & Analytics IT team. The ideal candidate will be responsible for expanding, optimizing, and meticulously maintaining our data pipeline architecture. This position involves working closely with cross functional teams, including data source teams, data consumers, SME’s, to ensure smooth data flow, efficient data collection, and data product development. The focus will be on re-engineering our data architecture, ensuring it aligns with the organization architectural guiding principles and support our next-generation data initiatives.
  
  Roles and Responsibility
  • Possesses 6-10 years of experience in developing and architecting with AWS, Snowflake data engineering solutions.
  • Design, build and operationalize large scale enterprise data solutions and applications using AWS services like S3, Glue, Lambda, SNS, EC2, IAM & KMS, and Snowflake (snowpipe, streams, tasks stored procedures)
  • Should be able to collaborate with analytics partners to gather requirements, propose the best cloud solutions and implement them effectively.
  • Follow established project execution processes, coding standards, and industry best practices.
  • Should be aware about AWS, Snowflake and Data security principles.
  • Get actively involved in Training, self-development & knowledge sharing activities. Contribute actively to organization-level cloud initiatives.
  • Problem solver with analytical thinking and ability to apply root cause analysis.
  • Demonstrate a good learning attitude to quickly master new services/technologies and adapt to working both independently and collaboratively.
  • Focus on continuously improving solutions and personal development.
  • Possess excellent communication and collaboration skills, with the ability to communicate important and relevant information concisely and clearly.

• Skills set:
  • 6-10 years of experience in data engineering with 4-6 years in lead role.
  • Proficiency in BI, Python, SQL, and working with relational databases.
  • Proven experience in building and optimizing data pipelines, architectures, and data sets.
  • Experience with CI/CD Pipelines in GitHub and Jenkins
  • Strong communication and collaboration skills
  
  Must have Skills:

  Extensive experience with AWS services: S3, Glue, Lambda, SNS, EC2, IAM and KMS

  Proficiency in CI/CD Pipelines in GitHub, and Snowflake features like streams, tasks, stored procedures, snowpipe and data sharing.

  
  Good to have Skills:
  Hands on experience/Familiarity with one/more of the following technologies: Database, Data Visualization (Power BI), Scripting, ETL (Informatica PowerCenter), understand data mesh architectures. Nice to have Cloud certifications in AWS, Snowflake.

We are looking for a passionate Lead Data Engineer who is self-driven, takes ownership of their work, and is committed to building high-quality, scalable data solutions. If you are ready to lead and innovate in a dynamic environment, we’d love to hear from you!