Superintelligence

The lesson of this little story is that if and when human-level AI is achieved, superintelligence will soon follow. […] What we have in this story seems to be a form of collective superintelligence.

On Thursday, Meta unveiled a $14.3 billion investment and partnership that will be the core of a new artificial intelligence research lab dedicated to the pursuit of “superintelligence,” a swing-for-the-fences effort in the global technology race. […] Silicon Valley leaders are now talking about building superintelligence, which would be even more powerful than A.G.I. It, too, is a loosely defined term, but generally refers to a machine that is more powerful than the human brain.

Fundamentally, people like Mr. Altman, the Anthropic chief executive Dario Amodei and countless other tech leaders and investors had put far too much faith into a speculative and unproven hypothesis called scaling: the idea that training A.I. models on ever more data and using ever more hardware would eventually lead to A.G.I. or even a superintelligence that surpasses humans.