We're going to use CodeProject.AI Server to handle all the annoying setup, deployment, and lifecycle management so we can focus on the code.
Traditionally, modules for CodeProject.AI Server operate on the assumption that any inferencing is quick enough, but for LLMs, long running processes need to be introduced.
[
add
]
[
|
|
...
]