MLCommons has formed a new working group, MLPerf Client, to establish AI benchmarks for desktops, laptops, and workstations running various operating systems.
The first benchmark will focus on text-generating models, specifically Meta's Llama 2, and will be scenario-driven, focusing on real end-user use cases.