4 ms·

This brings up the question how efficient the human brain is. As AI keeps catching up more and more with human intelligence, will it also need more and more ha

by mg 3y ago

This brings up the question how efficient the human brain is. As AI keeps catching up more and more with human intelligence, will it also need more and more hardware? Can it achieve human and superhuman intelligence and still run on a device like the iPhone, which weights about 170g? The human brain is 8 times heavier.

fumar 3y ago
Did our brains optimize for size, weight, and or power efficiency?
- nerdbert 3y ago
  Almost certainly, yes. But they also have to carry around their resource gathering and self-repair systems, something phones don't have to worry about.
  - MBCook 3y ago
    They also optimized for what we need to actually do, not the kind of “AI“ computers currently perform.
acchow 3y ago
The iPhone 15 neural engine does 35Tflops, which is about on par with the fastest supercomputer from 2002. Maybe in 24 years the iPhone 39 will have the computing power that OpenAI has today? Hopefully our compression gets much better in the meantime.
filterfiber 3y ago
> still run on a device like the iPhone, which weights about 170g [1]? The human brain is 8 times heavier. Why are you comparing the weight? I'm sorry but this is a bizarre comparison. This isn't even apples to oranges, this is apples to a telephone pole. I'll also throw in that a single Nvidia H100 is 1200 grams. Unless you have a "Bracket with screws" which will add 20 grams (who wouldn't want an extra 20grams of intelligence?). Like 70%+ of the human brain is water. The human brain needs a massive network of systems to transport nutrients/oxygen which is irrelevant to logical processing. Similarly the majority of the iphone weight is the battery and frame. The weight of the processing chip is _grams_. Besides the conflicting variables with the weight, the way that ML works on a physical level is completely different from the human brain.

by mg 3y ago

fumar 3y ago

Did our brains optimize for size, weight, and or power efficiency?

nerdbert 3y ago
Almost certainly, yes. But they also have to carry around their resource gathering and self-repair systems, something phones don't have to worry about.
- MBCook 3y ago
  They also optimized for what we need to actually do, not the kind of “AI“ computers currently perform.

acchow 3y ago

The iPhone 15 neural engine does 35Tflops, which is about on par with the fastest supercomputer from 2002. Maybe in 24 years the iPhone 39 will have the computing power that OpenAI has today? Hopefully our compression gets much better in the meantime.

filterfiber 3y ago

> still run on a device like the iPhone, which weights about 170g [1]? The human brain is 8 times heavier. Why are you comparing the weight? I'm sorry but this is a bizarre comparison. This isn't even apples to oranges, this is apples to a telephone pole. I'll also throw in that a single Nvidia H100 is 1200 grams. Unless you have a "Bracket with screws" which will add 20 grams (who wouldn't want an extra 20grams of intelligence?). Like 70%+ of the human brain is water. The human brain needs a massive network of systems to transport nutrients/oxygen which is irrelevant to logical processing. Similarly the majority of the iphone weight is the battery and frame. The weight of the processing chip is _grams_. Besides the conflicting variables with the weight, the way that ML works on a physical level is completely different from the human brain.