FIND_THE_RIGHTJOB.
India
Role Proficiency:
Act creatively to develop applications and select appropriate technical options optimizing application development maintenance and performance by employing design patterns and reusing proven solutions account for others' developmental activities
Outcomes:
Measures of Outcomes:
Outputs Expected:
Code:
Documentation:
Configure:
Test:
Domain relevance:
Manage Project:
Manage Defects:
Estimate:
Manage knowledge:
Release:
Design:
Interface with Customer:
Manage Team:
Certifications:
Skill Examples:
Knowledge Examples:
Mandatory Skills: data pipeline, Aws Sagemaker, Aws Glue, aws, python, Aws Lambda, Amazon Ec2, deployment, Athena, devops, ansible, web application, Aws Cloud, Aws Cloudformation, Terraform, Boto3, Code Pipeline, Code Deploy Skill to Evaluate: AWS,DataPipeLine,CloudInfra,Glue,Python,Pyspark,Athena,ETL,DevOps,CodePipeline Experience: 4 to 6 Years Location: Bengaluru Job Description: We are seeking an experienced Data Pipeline & Cloud Infrastructure Engineer to join our team. The ideal candidate will be responsible for building and maintaining robust data pipelines, managing cloud infrastructure (primarily EC2 and S3), supporting machine learning models, and ensuring smooth operations for web applications and analytics systems. You will work closely with data scientists and various teams to resolve issues, handle deployments, and maintain a secure environment Education Qualificaiton: Bachelor OF Engineering Roles & Responsibilities: Key Responsibilities: Data Pipeline Development & Maintenance Build and maintain data pipelines for data enrichment and loading into base tables for ML model integration. Leverage AWS services (Glue, Athena, S3) and Python (90%) + PySpark (10%) to ensure efficient data flow. Implement error handling and s with appropriate notifications. Collaborate with SRI Data Scientists to troubleshoot and resolve data-related issues. Workload Management Maintain EC2 workloads, ensuring security, setting up s, managing Linux environments, and handling deployments for machine learning models. Web Application Hosting Host web applications on EC2 for analytics purposes using Python and the Streamlit framework. Manage Linux-based EC2 instances, Elastic Load Balancers (ELB), and SSL/TLS certificates. Reporting & Monitoring Generate and maintain various reports including billing, bill consolidation, data stats, and daily activity reports. Adhoc Research Workloads Provision EC2 instances for short-term, ad-hoc research tasks by external users (e.g., interns). Manage the lifecycle of such instances, including provisioning, access, and decommissioning. Sagemaker User Management Add users and manage domains within AWS SageMaker (permissions and infrastructure support). No direct workload management but provide support related to infrastructure issues (e.g., access permissions). Network & Access Management Manage Virtual Private Clouds (VPCs) and access controls. Provide VPN access on an ad-hoc basis and handle IP whitelisting requests. CI/CD & Infrastructure Deployment Maintain CloudFormation (CFN) templates and deploy infrastructure for machine learning workflows. Manage the version control of the ML codebase through Git. Qualifications: Strong experience with AWS services (Glue, Athena, S3, EC2, VPCs). Proficiency in Python (90%) and PySpark (10%) for data processing and automation. Experience with web application hosting, particularly with Python/Streamlit framework. Familiarity with CI/CD pipelines, CloudFormation, and version control (Git). Experience with machine learning infrastructure and tools, particularly SageMaker, is a plus. Strong troubleshooting skills and the ability to collaborate with cross-functional teams. Preferred Skills: Linux system administration experience. Experience with security best practices, monitoring, and ing on cloud infrastructure. Knowledge of networking concepts (VPCs, VPN, IP whitelisting). Experience managing billing and report generation tasks. Additional Information: Flexible working hours based on project deadlines. Collaborative team environment with an opportunity to work with data scientists and engineers across various domains.
Python,Aws Glue,SQL, AWS S3,AWS Opensearch Service, AWS Secret manager
Similar jobs
JPMorganChase
India
10 days ago
LexisNexis Risk Solutions
India
10 days ago
RELX Group
India
10 days ago
Elsevier
India
10 days ago
SAP
India
10 days ago
MSD
India
10 days ago
Bank of America
India
10 days ago
© 2025 Qureos. All rights reserved.