One of the biggest problems is that TOPS - how many trillions of byte-sized operations your chip can process per second - is that it's missing a critical piece of information: precision.
Usually, when we talk about TOPS, it's assumed to mean at INT8, or 8-bit precision. However, with lower 6- and 4-bit data types becoming more common, it's no longer a given.
TOPS is just one of many factors that contribute to AI performance. Just because two chips are capable of producing similar performance in terms of TOPS or TFLOPS doesn't mean they can actually take advantage of them.
Memory bandwidth is just as important for AI PCs as it is for beefy datacenter.
[
Collection
]
[
|
...
]