Nvidia launches a set of microservices for optimized inferencing

At its GTC conference, Nvidia today announced Nvidia NIM, a new software platform designed to streamline the deployment of custom and pre-trained AI models into production environments. NIM takes the software work Nvidia has done around inferencing and optimizing models and makes it easily accessible by combining a given model with an optimized inferencing engine […]

© 2024 TechCrunch. All rights reserved. For personal use only.

Source: techcrunch.com