Job Description
Role Overview We are looking for a Senior Software Engineer for Deep Learning Inference. The role involves designing and building inference software to accelerate deep learning models, especially large language models, on NVIDIA GPUs. Responsibilities Craft and develop robust inference software scalable across platforms for functionality and performance. Develop components of TensorRT, NVIDIA’s SDK for high‑performance deep learning inference. Stay current with academic developments in AI and implement updates to TensorRT. Use C++ and Python to build graph parsers, optimizers, and tools for deploying trained deep learning models. Collaborate with deep learning experts, GPU architects, and DevOps engineers across teams. Qualifications Degree in Computer Science, Computer Engineering, Electrical Engineering, or equivalent experience. 3+ years of software development experience. Strong experience with modern C++ standards (C++11/C++14/C++17/C++20). Solid grasp of machine learning conce...
Ready to Apply?
Submit your application for Senior Software Engineer, Deep Learning Inference - TensorRT (Hiring Immediately) at NVIDIA
Apply Now