Director, Core Infrastructure Engineering

Role Overview

Here at OCI we’re building the world’s largest AI clusters and we’re the fastest at bringing them to the market. The AI Infrastructure organization at OCI is leading this effort by creating a GPU focused cloud with the latest hardware providing the best performance, efficiency, reliability, and scalability. This is your chance to be part of the AI revolution by creating systems that allow customers to scale from tens to thousands of GPUs without compromising performance. You will have the opportunity to work with cutting-edge technologies and make a significant impact on our organization's success.

We are looking for an engineering Director to lead software teams responsible for developing GPU control plane and scaling AI infrastructure. This includes providing customer APIs and workflows to manage latest Baremetal GPU capacity through New Product integration, configuring NVLink domains, managing compute clusters, repairs and firmware for AI workloads . In this role, you will set and communicate priorities and expectations to multiple teams led by senior managers and strong lead developers working on cutting-edge technologies. You will collaborate with cross-functional teams to enhance our AI infrastructure to deliver exceptional customer experience.

Responsibilities

Key Responsibilities

• Own and build solutions to scale and optimize GPU control plane with the goal to optimize customer experience and customer workload performance on our AI infrastructure.
• Build higher performance engineering teams, create organization roadmap, define SMART goals, and track organization’s progress against­ committed OKRs and milestones.
• Develop senior managers and Principal developers and drive modern software engineering practices like leveraging data/telemetry to make decisions, well-defined interfaces for customers and across components, design reviews, integration test and active production monitoring.
• Prioritize organization’s work with focus on customer issues and requirements.
• Ensure that team solutions are well-defined and modularized, secure, reliable, diagnosable, actively monitored, compliant and reusable.
• Implements strategies across multiple teams or groups for the architecture and design of interdependent scalable distributed systems, including the use of distributed state management tools, ensuring organizational and system demands are met.
• Provides strategic oversight for the architecture of fault-tolerant interdependent systems capable of withstanding in-service updates by overseeing implementation across teams of redundancy, replication, and automatic failover mechanisms.
• Influences and sets direction for designing systems to effectively handle service disruptions (e.g., network partitions) by prioritizing consistency, availability, or partition tolerance.
• Provides strategic oversight for diagnosing, debugging, and resolving issues in active systems to support ongoing operation.
• Provides strategic guidance in architecting robust security measures to protect data and applications in multi-tenant environments, ensuring encryption techniques and access controls are implemented.
• Provides strategic guidance across teams on developing and maintaining automation scripts and tools (e.g., Infrastructure as Code (IaC)) to manage cloud infrastructure.

Qualifications & Skills

• BS (or equivalent experience) in Computer Science, Engineering, or related field.
• 10 years of experience in software development with programming languages including, but not limited to, C, C++, C#, Java, Go, Rust.
• 5 years of experience in people management or leadership role while working on cross-functional projects.
• 5 years of experience designing and developing large-scale distributed systems, services, and infrastructure.
• Strong communication, collaboration, and project management skills.
• Ability to adapt to a fast-paced, dynamic environment and manage multiple tasks and priorities effectively.

Preferred Qualifications

• Experience in managing cloud infrastructure with hundreds of thousands of servers.
• Experience in scheduling high-performance workloads on Kubernetes or Slurm.

Application Instructions

Apply directly on Oracle Careers at Director, Core Infrastructure Engineering↗.