3 ms·

It is not a good analogy for LLMs and the infrastructure that is needed for running them, not by an inch. The variability of scale is not there, according to OA

It is not a good analogy for LLMs and the infrastructure that is needed for running them, not by an inch. The variability of scale is not there, according to OAI we need massive piles of resources for allowing innovation by common people (i.e. scale it, make it an utility and then wait for emergent use cases). Electricity didn't need the scale sama is asking for thriving as a tech (obviously eventually it did explode in use cases with enough scale, but that's not my point). Scientists used to make electromagnetism experiment demonstrations in Academies with equipment that was not that expensive nor inaccesible for the time. You can even produce enough electricity with a potato to light a bulb. A better technology for this analogy would be promoting on-device/on-site open SLMs, but that's not what OAI promotes, is it?

jononor 2y ago
You can train a tiny LLM and do experiments on it and demonstrations with your lapop. It is about as accessible as electricity generating potatoes.
dotancohen 2y ago
> Scientists used to make electromagnetism experiment demonstrations in Academies with equipment that was not that expensive nor inaccesible for the time. I'm not even a scientist, yet I've made experimental demonstrations with LLMs using equipment that is certainly not expensive nor inaccesible.
- mrbungie 2y ago
  At least in the case of researchers, like the ones working on the PlanBench benchmarks they were kindly asking for increasing API rate limits for running the benchmarks on o1 (https://x.com/rao2z/status/1834314021912359393?s=46&t=u6bMGXmWqzTwApAb4JyJjw https://x.com/rao2z/status/1834314021912359393?s=46&t=u6bMGX...). Treat it as a perdonal opinion but I really think the analogy resists no analysis after situations like that. If it is closed (and that's what OAI proposes, they aren't advocating for open models but the contrary), it will never be like electricity.

jononor 2y ago

You can train a tiny LLM and do experiments on it and demonstrations with your lapop. It is about as accessible as electricity generating potatoes.

dotancohen 2y ago

> Scientists used to make electromagnetism experiment demonstrations in Academies with equipment that was not that expensive nor inaccesible for the time. I'm not even a scientist, yet I've made experimental demonstrations with LLMs using equipment that is certainly not expensive nor inaccesible.

mrbungie 2y ago
At least in the case of researchers, like the ones working on the PlanBench benchmarks they were kindly asking for increasing API rate limits for running the benchmarks on o1 (https://x.com/rao2z/status/1834314021912359393?s=46&t=u6bMGXmWqzTwApAb4JyJjw https://x.com/rao2z/status/1834314021912359393?s=46&t=u6bMGX...). Treat it as a perdonal opinion but I really think the analogy resists no analysis after situations like that. If it is closed (and that's what OAI proposes, they aren't advocating for open models but the contrary), it will never be like electricity.