Managing Consultant Data Engineering

Job Summary:

We are looking for a highly skilled and proactive Data Engineers with 3+ years of hands-on experience in designing, deploying, and managing scalable cloud infrastructure, primarily on AWS. The ideal candidate will have strong proficiency in cloud-native services (such as EC2, S3, RDS, Redshift, Lambda, and EMR), infrastructure as code (CloudFormation), and modern CI/CD practices using tools like Jenkins and GitLab CI/CD.

Job Responsibilities:

• Design, deploy, and manage AWS infrastructure using services such as EC2, S3, RDS, Redshift, Lambda, and EMR.

• Automate cloud infrastructure provisioning using AWS CloudFormation or equivalent tools.

• Containerize applications and data services using Docker.

• Deploy and manage Kubernetes clusters (EKS, AKS, GKE), ensuring high availability and scalability.

• Work closely with development, operations, and security teams to align infrastructure with business needs.

• Provide technical guidance and support for cloud-native development and DevOps practices.

Job Requirements:

• Proficiency in one or more major cloud providers with hands-on experience of 5+ years
  o AWS – EC2, S3, RDS, Redshift, Lambda, EMR, CloudFormation, EKS, Glue.
  o Experience with CI/CD Pipelines: Jenkins, GitLab CI/CD
• Understanding of containerized environments:
  o Docker – Containerization of data services and apps
  o Kubernetes – Deployment and orchestration (EKS, AKS, GKE)
• Security & Governance
  o IAM & Role-based access control (RBAC)
  o Key Management Services (KMS)