iTWire Tuesday, 13 April 2021 03:01 Nvidia announces data centre CPU and much more
Shares Nvidia s new Grace CPU
As usual, Nvidia had a raft of product announcements ready for its annual GTC conference which started today. Among the standouts were the Grace data centre CPU, a next-generation BlueField DPU, Omniverse Enterprise for 3D collaboration, and updates to the company s Drive platform.
Grace – named after computing pioneer Grace Hopper – is Nvidia s first data centre CPU, designed for extremely large-scale AI and HPC workloads.
Model sizes are doubling every 2.5 months, said Nvidia senior director of accelerated computing Paresh Kharya, pointing to the way the GPT-3 model uses 175 billion parameters. This suggests 100 trillion parameter models will exist by 2023.