There are more than 8,500 performance results in the MLCommons' latest benchmark, testing all manner of combinations and permutations of hardware, software and AI inference use cases.
ChatGPT: "This was our most expensive benchmark so far," MLCommons Executive Director David Kanter told Reuters. "We spent over 600K hours of accelerator compute time to develop it, plus some fantastically talented engineers."
San Francisco, June 27 (Reuters) - MLCommons, a group
that develops benchmark tests for artificial intelligence (AI)
technology, on Tuesday unveiled results for a new test that
determines system speeds when training algorithm.