"It is unlikely that you'll write it from scratch or write a whole bunch of Python code or anything like that," he said on stage during his GTC keynote.
Dubbed Nvidia Inference Microservices, or NIM for short, these are essentially container images containing both the model, whether it be the open source or proprietary, along with all the dependencies necessary to get it running.
[
add
]
[
|
|
...
]