Data Engineer

Job Description

Must Have Technical/Functional Skills

• Design, develop, and maintain PostgreSQL databases and data pipelines on AWS to support microservice-based applications.
• Design and develop scalable, efficient data models aligned with the microservice-based System of Record (SOR) architecture.
• Collaborate with Java microservice developers to integrate database solutions efficiently with application services.
• Build and optimize ETL/ELT workflows for data ingestion, transformation, and storage using AWS services and custom scripts.
• Tune PostgreSQL databases for performance, scalability, and reliability in a microservices environment.
• Develop and maintain database schemas, stored procedures, and complex SQL queries aligned with application needs.
• Automate database provisioning, schema migrations, backups, and monitoring using AWS tools and infrastructure as code (CloudFormation, Terraform).
• Implement data modeling best practices to support analytics, reporting, and application functionality.
• Ensure data security, integrity, and compliance with organizational policies and cloud security standards.
• Troubleshoot and resolve database and data pipeline issues in development, staging, and production environments.
• Participate in designing and implementing disaster recovery and high availability strategies for critical data systems.
• Lead or support Salesforce to PostgreSQL (Aurora PostgreSQL) data migration projects, ensuring data accuracy and integrity.
• Stay current with PostgreSQL, AWS data services, Java microservices frameworks, and industry best practices.
• Experience with Salesforce data structures and migration tools (e.g., Salesforce Data Loader, APIs).
• AWS Certified Data Analytics – Specialty, AWS Certified Database – Specialty, or AWS Certified Developer – Associate.
• Experience with containerization and orchestration tools such as Docker and Kubernetes.
• Familiarity with streaming data platforms like Kafka or AWS Kinesis.
• Knowledge of CI/CD pipelines and DevOps practices.
• Experience with monitoring and logging tools such as CloudWatch, Prometheus, or Grafana.
  
  

Roles & responsibilities

• Bachelor’s degree in Computer Science, Engineering, or related field.
• Proven experience as a Data Engineer, Database Engineer, or Backend Developer with PostgreSQL expertise.
• Strong proficiency in PostgreSQL database design, query optimization, and performance tuning.
• Hands-on experience with AWS services such as Amazon RDS (PostgreSQL), Aurora PostgreSQL, S3, Lambda, Glue, and Redshift.
• Solid ex perience in Java microservice development using frameworks like Spring Boot or similar.
• Proficiency in SQL and experience writing complex queries, stored procedures, and functions.
• Experience building and maintaining ETL/ELT pipelines using Python, Airflow, AWS Glue, or similar tools.
• Familiarity with infrastructure as code tools like CloudFormation or Terraform for automation.
• Strong scripting skills (Python, Bash) for automation and data processing.
• Understanding of cloud security best practices and data governance.
• Excellent problem-solving skills and ability to work collaboratively in agile, cross-functional teams.
  
  

Salary Range: $130,000 to $150,000 per year

Qualifications: BACHELOR OF COMPUTER SCIENCE