MLCommons produces benchmark of AI model safety
Briefly

"If you look at aviation, for instance, you can look all the way back to the sketchbooks of Leonardo da Vinci - great ideas that never quite worked... But there was a tremendous amount of work from that first flight to the almost unbelievably safe commercial aviation we depend on today. Many of us in this room wouldn't be here if not for all the work and the measurement that enabled that progress to a highly reliable, low risk service."
"To get here for AI, we need standard AI safety benchmarks. We need to have those established to ensure responsible development and deployment of AI technologies that could impact users and society."
Read at Theregister
[
|
]