Inferencing is the process that transforms a submitted prompt into its response. Doing so needs a machine that can grind through multiple gigabytes of data - and even more matrix multiplications.
Treating memory as 'unified' - it's all VRAM if it needs to be - all modern M-series Macs with at least 16GB of RAM can serve as an AI PC.
[
add
]
[
|
|
...
]