About the role
NVIDIA is looking for an outstanding, passionate, and dedicated Senior AI Infrastructure Engineer to join our DGX Cloud group. This engineering role will design, build and maintain large-scale production systems with high efficiency and availability using a combination of software and systems engineering practices. This role demands knowledge across different systems, networking, coding, databases, capacity management, continuous delivery and deployment, and open-source cloud-enabling technologies like Kubernetes and OpenStack.
The DGX Cloud Production Engineer at NVIDIA ensures our GPU cloud services deliver maximum reliability and uptime. They carefully prepare and plan changes to the system. They also manage capacity and performance. NVIDIA values diversity, curiosity, problem-solving, and openness. Our team includes people with varied backgrounds and perspectives. We encourage collaboration, big thinking, and risk-taking without blame. We promote self-direction on meaningful projects. We also provide support and mentorship to foster learning and growth.
What You’ll Be Doing:
- Design, build, deploy, and run internal tooling for large-scale AI training and inferencing platform built on top of cloud infrastructure.
- Conduct in-depth performance characterization and analysis on large multi-GPU and multi-node clusters.
- Engage in and improve the whole lifecycle of services—from inception and design through deployment, operation, and refinement.
- Support services before they become available through activities such as system design consulting, developing software tools, platforms, and frameworks, capacity management, and launch reviews.
- Maintain services once they are live by measuring and monitoring availability, latency, and overall system health.
- Scale systems sustainably through mechanisms like automation, and evolve systems by pushing for changes that improve reliability and velocity.