Middle Big Data DevOps Engineer

We are looking for a skilled Big Data DevOps Engineer with profound knowledge of cloud technologies and experience with a variety of data tools and platforms.

The ideal candidate will have proven experience in managing and optimizing big data operations across cloud environments.

Responsibilities

• Cloud Solutions Development: Build, deploy, and maintain scalable and secure big data solutions across major cloud platforms (AWS, Azure, Google Cloud) to support advanced data processing and analytics
• Data Tools Management: Configure and manage data processing tools such as Apache Spark, Kafka, Airflow, and Databricks to efficiently handle large-scale data workflows
• Automation and CI/CD: Utilize Terraform for infrastructure as code, automate workflows with Jenkins, and maintain code with GitLab for continuous integration and continuous delivery processes
• Performance Optimization: Monitor and optimize the performance of big data tools and cloud platforms, ensuring cost-effectiveness and operational efficiency
• Security and Compliance: Implement and enforce data security measures, ensuring compliance with data protection regulations and best practices in cloud environments
• Collaborative Development: Work collaboratively with data scientists, data engineers, and other stakeholders to understand requirements and deliver high-quality data solutions

Requirements

• Strong experience with big data technologies, particularly Apache Spark or Databricks
• Extensive background in cloud services administration with platforms like AWS, Azure, or Google Cloud
• In-depth knowledge of infrastructure as code using Terraform
• Proficiency in implementing CI/CD pipelines with tools such as Jenkins, GitLab or GitHub Actions
• Solid scripting skills in Python, Scala, or similar languages
• Experience with SQL and relational/non-relational databases
• Excellent problem-solving abilities and a team-oriented attitude

Nice to have

• Certifications in cloud technology (e.g., AWS Certified Solutions Architect, Google Cloud Certified Professional Cloud Architect)
• Additional experience with real-time data processing tools like Apache Kafka

We offer

• CONTINUOUS UPSKILLING, LEARNING & DEVELOPMENT
  • Diversity of tasks and projects
  • Assessment center for objective review of competency level
  • Personal development plan
  • Mentoring programs and leadership development
  • Certification and professional development support
  • Access to learning platforms including more than 2,500 internal courses and the LinkedIn Learning library with 20,000+ courses
  • English courses taught by certified teachers
• CORPORATE BENEFITS
  • Extra leave days
  • Referral bonuses
• COMPENSATION PACKAGE
  • Competitive compensation paid in USD
  • Regular salary and performance reviews
• MEDICAL & HEALTHCARE
  • Private health insurance
  • Well-being events
• WORKING ENVIRONMENT
  • Recreation areas and kitchens
  • Tea, coffee, and snacks
  • Well-being events
  • Sports equipment and game consoles
  • IT Equipment
  • Microsoft's Software Assurance Home Use Program (HUP)

EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.