Scientific American
How to Make Artificial Intelligence More Democratic
A new type of learning model uses far less data than conventional AIs, allowing researchers with limited resources to contribute
Advertisement
This year, GPT-3, a large language model capable of understanding text, responding to questions and generating new writing examples, has drawn international media attention. The model, released by OpenAI, a California-based nonprofit that builds general-purpose artificial intelligence systems, has an impressive ability to mimic human writing, but just as notable is its massive size. To build it, researchers collected 175 billion parameters (a type of computational unit) and more than 45 terabytes of text from Common Crawl, Reddit, Wikipedia and other sources, then trained it in a process that occupied hundreds of processing units for thousands of hours.
California
United-states
Western-university
Ilia-sucholutsky
Matthias-schonlau
University-of-waterloo
National-institute-for-standards
Common-crawl
National-institute
கலிஃபோர்னியா
ஒன்றுபட்டது-மாநிலங்களில்
மேற்கு-பல்கலைக்கழகம்