Databricks Admin

EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.

We are seeking a skilled and experienced Databricks Admin to join our team and lead the deployment, management, and enhancement of our data infrastructure. The ideal candidate will have a strong background in Azure Databricks, Azure Datalake, and related cloud solutions, with a passion for driving innovation in data engineering through automation and technical expertise.

Responsibilities

• Conceptualize the design and develop technical solutions for Azure Databricks architecture configuration
• Implement Databricks Lakehouse architecture and provide technical leadership to enable its successful adoption
• Manage Databricks infrastructure by integrating it seamlessly with existing network, security, messaging, and remote access components
• Automate Databricks environment deployments through Infrastructure as Code (IaC) practices
• Troubleshoot and resolve performance, connectivity, and security issues in Databricks environments, including providing on-call production support
• Design and implement monitoring and alerting solutions for Databricks environments, along with standardizing access patterns and developing high-availability and disaster recovery solutions
• Maintain comprehensive documentation for Databricks solutions, including design documents, data dictionaries, and operational procedures
• Integrate Databricks with third-party applications such as Dataiku, Starburst, Immuta, Collibra, and Snowflake
• Stay informed on advancements in the data engineering and big data ecosystems, identifying opportunities to evolve Databricks-based solutions
• Advocate for Databricks and its capabilities, promoting its value across organizational teams
• Lead, coach, and mentor team members by providing technical guidance and support
• Foster collaborative relationships with technology teams and business partners to align technology initiatives with business objectives
• Leverage agile methodologies to address challenges and contribute to technical decision-making

Requirements

• 8+ years of relevant experience
• Hands-on experience in architecting, deploying, managing, and supporting Azure Databricks, Azure Datalake, and related solutions
• Hands-on experience with cloud provider tools and architecture, particularly on Azure
• Expertise using scripting languages and CLI tools such as Ansible, SQL, Terraform, Azure CLI, Databricks CLI, PowerShell, or Bash
• Knowledge of data ingestion and pipeline patterns, including tools like Qlik Replicate, Qlik Compose, Databricks, Kafka, Matillion ELT, and Snowflake Services
• Familiarity with working in an agile product development environment
• Strong communication skills with the ability to articulate system designs and patterns across various organizational levels
• English level of minimum B2 (Upper-Intermediate) for effective communication

Nice to have

• Experience managing and tuning data platforms such as Azure ADLS Storage and Databricks
• Proficiency with additional Azure services like Synapse Analytics, Key Vault, or DataFactory
• Knowledge of maintaining CI/CD pipelines and versioning tools, such as Git

We offer

• Opportunity to work on technical challenges that may impact across geographies
• Vast opportunities for self-development: online university, knowledge sharing opportunities globally, learning opportunities through external certifications
• Opportunity to share your ideas on international platforms
• Sponsored Tech Talks & Hackathons
• Unlimited access to LinkedIn learning solutions
• Possibility to relocate to any EPAM office for short and long-term projects
• Focused individual development
• Benefit package:
  • Health benefits
  • Retirement benefits
  • Paid time off
  • Flexible benefits
• Forums to explore beyond work passion (CSR, photography, painting, sports, etc.)