4 ms·

The level of hubris when comparing something that brings literal physical light to something that is not even public or reproducible.

dotancohen 2y ago
When electricity was first brought to people's homes, it wasn't something that could be easily produced in the home either. This is an analogy, not a formula. And a great aspiration for a company that until recently was at the forefront of its industry.
- mrbungie 2y ago
  It is not a good analogy for LLMs and the infrastructure that is needed for running them, not by an inch. The variability of scale is not there, according to OAI we need massive piles of resources for allowing innovation by common people (i.e. scale it, make it an utility and then wait for emergent use cases). Electricity didn't need the scale sama is asking for thriving as a tech (obviously eventually it did explode in use cases with enough scale, but that's not my point). Scientists used to make electromagnetism experiment demonstrations in Academies with equipment that was not that expensive nor inaccesible for the time. You can even produce enough electricity with a potato to light a bulb. A better technology for this analogy would be promoting on-device/on-site open SLMs, but that's not what OAI promotes, is it?
  - jononor 2y ago
    You can train a tiny LLM and do experiments on it and demonstrations with your lapop. It is about as accessible as electricity generating potatoes.
  - dotancohen 2y ago
    > Scientists used to make electromagnetism experiment demonstrations in Academies with equipment that was not that expensive nor inaccesible for the time. I'm not even a scientist, yet I've made experimental demonstrations with LLMs using equipment that is certainly not expensive nor inaccesible.
    - mrbungie 2y ago
      At least in the case of researchers, like the ones working on the PlanBench benchmarks they were kindly asking for increasing API rate limits for running the benchmarks on o1 (https://x.com/rao2z/status/1834314021912359393?s=46&t=u6bMGXmWqzTwApAb4JyJjw https://x.com/rao2z/status/1834314021912359393?s=46&t=u6bMGX...). Treat it as a perdonal opinion but I really think the analogy resists no analysis after situations like that. If it is closed (and that's what OAI proposes, they aren't advocating for open models but the contrary), it will never be like electricity.

dotancohen 2y ago

When electricity was first brought to people's homes, it wasn't something that could be easily produced in the home either. This is an analogy, not a formula. And a great aspiration for a company that until recently was at the forefront of its industry.

mrbungie 2y ago
It is not a good analogy for LLMs and the infrastructure that is needed for running them, not by an inch. The variability of scale is not there, according to OAI we need massive piles of resources for allowing innovation by common people (i.e. scale it, make it an utility and then wait for emergent use cases). Electricity didn't need the scale sama is asking for thriving as a tech (obviously eventually it did explode in use cases with enough scale, but that's not my point). Scientists used to make electromagnetism experiment demonstrations in Academies with equipment that was not that expensive nor inaccesible for the time. You can even produce enough electricity with a potato to light a bulb. A better technology for this analogy would be promoting on-device/on-site open SLMs, but that's not what OAI promotes, is it?
- jononor 2y ago
  You can train a tiny LLM and do experiments on it and demonstrations with your lapop. It is about as accessible as electricity generating potatoes.
- dotancohen 2y ago
  > Scientists used to make electromagnetism experiment demonstrations in Academies with equipment that was not that expensive nor inaccesible for the time. I'm not even a scientist, yet I've made experimental demonstrations with LLMs using equipment that is certainly not expensive nor inaccesible.
  - mrbungie 2y ago
    At least in the case of researchers, like the ones working on the PlanBench benchmarks they were kindly asking for increasing API rate limits for running the benchmarks on o1 (https://x.com/rao2z/status/1834314021912359393?s=46&t=u6bMGXmWqzTwApAb4JyJjw https://x.com/rao2z/status/1834314021912359393?s=46&t=u6bMGX...). Treat it as a perdonal opinion but I really think the analogy resists no analysis after situations like that. If it is closed (and that's what OAI proposes, they aren't advocating for open models but the contrary), it will never be like electricity.