Principal Engineer - Big Data Service

Big Data Service team’s charter is to offer a managed, cloud-native Big Data Service focused on large-scale data processing and analytics on unstructured data stored in data lakes, and management of the data in data lakes. The service work scope encompasses not just good integration with OCI’s native infrastructure (security, cloud, storage, etc.) but also deep integration with other relevant cloud-native services in OCI (like Oracle Kubernetes, Data Catalog, ADW, etc.). It includes doing cloud-native ways of doing service level patching & upgrades and maintaining high availability of the service in the face of random failures & planned downtimes in the underlying infrastructure (e.g., for things like patching the Linux kernels to take care of a security vulnerability). Developing systems for monitoring and getting telemetry into the service’s runtime characteristics and being able to take actions on the telemetry data is a part of the charter.

We are interested in senior engineers with expertise and passion for solving difficult problems in distributed systems and highly available services. At Oracle, you can help, shape, design, and build innovative new systems from the ground up. These are exciting times in our space - we are growing fast, still at an early stage, and working on ambitious new initiatives. Engineers at any level can have significant technical and business impact.

Qualifications

• Deep understanding of how distributed resilient software is built and deployed.
• Prior experience in building, or contributing to, distributed data-intensive systems
• Experience delivering and operating large-scale, highly available distributed systems.
• Experience with larger projects (large codebases)
• Experience with open-source software in the Big Data ecosystem
• Experience at an organization with strong operational/dev-ops culture
• Expertise in coding in Java, Scala with emphasis on tuning/optimization
• Good software engineering skills:
• know how to write clean, testable, and maintainable code
• write documentation
• understanding of simple and robust designs, including designing APIs

Bonus

• Deep understanding of Java and JVM mechanics
• Interested in speaking about their work, internally and externally, or writing articles
• BS in Computer Science or a related technical field or equivalent practical experience.
• Solid foundation in data structures, algorithms, and software design with strong analytical and debugging skills.
• Passion for learning and always improving yourself and the team around you

What To Expect From The Job

• Working on distributed data-intensive systems, often as part of open source communities.
• Taking ownership of critical parts of the cloud service, including shaping its direction.
• Code, integrate, and operationalize open and closed source data ecosystem components for Oracle cloud service offerings
• Becoming an active member of the Apache open source community when working on open source components
• Optionally: Presenting work at conferences, meetups, or via articles.
• Working with, and supporting customers/users of the cloud service