Senior Performance Engineer

NVIDIA is seeking a highly skilled Senior Performance Engineer to join our Performance and R&D organizations. In this role, you will help build and evolve systems that support performance analysis, telemetry, and optimization for large-scale GPU- and CPU-based clusters used in AI and high-performance computing environments. You will work closely with hardware, networking, firmware, and software teams to collect, analyze, and interpret performance data from live systems. This is a fast-paced R&D environment where system behavior and requirements evolve rapidly, requiring adaptable engineering solutions and strong analytical thinking.

What you’ll be doing:

• Profile, benchmark, and analyze AI and HPC workloads on GPU and CPU clusters

• Explore performance characteristics of high-performance networking and collective communications (e.g., NCCL, RDMA, MPI, RoCE)

• Identify performance bottlenecks across networking, compute, memory, and system architecture

• Develop and enhance performance analysis, benchmarking, and diagnostic tools

• Define performance test plans and establish expectations for new technologies and platforms

• Collaborate across hardware, firmware, networking, systems, and software teams to provide actionable performance insights

• Support telemetry collection and data refinement efforts to enable accurate performance analysis

• Maintain high standards for data quality, reproducibility, and traceability of performance results

What we need to see:

• B.Sc. or M.Sc. in Computer Science, Computer Engineering, Software Engineering, or equivalent experience

• 5+ years of experience in performance analysis, systems engineering, or HPC/AI infrastructure

• Demonstrated expertise in performance analysis skills and methodologies

• Hands-on experience with high-performance networking (RDMA, MPI, NCCL, congestion control)

• Strong understanding of system performance metrics (latency, throughput, resource utilization)

• Exposure to hardware, firmware, or embedded telemetry environments

• Strong analytical, problem-solving, and communication skills

• Ability to work effectively in cross-functional, fast-paced R&D teams

Ways to stand out from the crowd:

• Knowledge of CUDA, NCCL internals, and congestion control algorithms

• Deep system-level understanding of CPU architectures, GPUs, HCAs, memory, and PCIe

• Experience with NVIDIA GPUs, CUDA, and deep learning frameworks such as PyTorch or TensorFlow

• Experience with cloud platforms 

• Proficiency in Python; experience with Bash and C/C++ is a plus as well as a strong experience working in Linux environments