Job Details

Senior Performance Software Engineer, AI Applications

NVIDIA Corporation
Santa Clara, California, United States

We are now looking for a Senior Software Performance Engineer to work on our NeMo Large Language Model Service engineering team. Our team is building next-generation services and interfaces for training and deploying AI at scale. We are dedicated to developing speech and NLP technologies that tackle real problems. We contribute to all steps of the machine learning lifecycle: from conceptualization, to applied research, engineering for optimized inference, and deployment.

What you'll be doing:

  • Design and implement performance & load tests across services and libraries to increase understanding of system behavior under positive and negative conditions

  • Collect and organize performance data and share with key stakeholders

  • Identify performance issues through profiling of the various components

  • Work closely and collaborate with engineering teams to improve the performance of the deployed services

  • Resolve system and software bottlenecks by writing optimized algorithms, using NVIDIA accelerated computing platforms

What we need to see:

  • Masters or PhD or equivalent experience in Computer Science, computer architecture, or related field

  • 7+ years of experience

  • Ability to work independently, define project goals and scope, interact directly with open source community, and manage your own development effort

  • Experience with high-volume, scalable, distributed systems

  • Excellent programming and software design skills, including debugging, performance analysis, and test design

  • Excellent troubleshooting abilities spanning multiple software (storage systems, kernels and containers)

  • Experience building and deploying cloud services using HTTP REST, gRPC, protobuf, JSON and related technologies

Ways to stand out from the crowd:

  • Experience with machine learning algorithms and frameworks; especially experience with frameworks such as PyTorch, Tensorflow, ONNX Runtime, and TensorRT

  • Background with container technologies, such as docker, singularity, and LXC

  • Experience with containers orchestrators as Kubernetes, Docker Swarm, Mesos or Nomad

  • Knowledge of GPU programming such as OpenCL or CUDA

  • Knowledge of or experience with developing production speech AI technologies

NVIDIA is widely considered to be one of the technology world's most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us. Are you creative and autonomous? Do you love a challenge? If so, we want to hear from you. Come help us build the real-time, efficient computing platform driving our success in the multifaceted and quickly growing field of Deep Learning and Artificial Intelligence.

The Colorado Equal Pay for Equal Work Act requires that NVIDIA provide the compensation range and benefits offered for this position if performed in Colorado. The base salary range for this position in Colorado is $162 750.00 USD.

NVIDIA also offers a comprehensive benefits package. We provide health care coverage, dental and vision, 401(K), including company matching and after tax contributions, Employee Stock Purchase Program (ESPP), Employee Assistance Program (EAP), company paid holidays, paid sick leave, vacation leave, professional time off, life and disability protection. Employees in eligible sales and positions may also be eligible for commission.

Base pay is based on market location and may vary based on factors including experience, skills, education, and other job-related reasons.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Send application

Mail this job to me so I can apply later

Apply With CV

You are not logged in. If you have an account, log in to your account. If you do not have an account, why not sign up? It only takes a minute!

latest videos

Upcoming Events