3 ms·

I had somehow entirely forgotten about Boston Dynamics and their extremely impressive demos over the past few years. Being reminded now, in context of generati

• vinnymac 3y ago
  LLMs vary in there resource requirements. The best models at the moment require beefy hardware, but you could still run a handful of 7B models, at the same time, with a top of the line laptop. With a custom build they could do something far more impressive.
  • boppo1 3y ago
    My $3000 (custom) consumer desktop runs llama2 70B at ~3-6 t/s iirc. Boston Dynamics can absolutely get LLMs to run on these things.
    • gs17 3y ago
      That desktop would add a lot to the power requirements, though.