4 ms·

It's truly amazing how quickly my browser loads 0.6GB of data. I remember when downloading a 1MB file involved phoning up a sysop in advance and leaving the mod

It's truly amazing how quickly my browser loads 0.6GB of data. I remember when downloading a 1MB file involved phoning up a sysop in advance and leaving the modem on all night. We've come so far.

zozbot234 2y ago
You could more or less fit the full model on a single CD (or a DVD for the larger model sizes) but of course forget about trying to do inference for it on period hardware, it would be unusably slow.
doctorpangloss 2y ago
97MB for the Worms 3 demo felt like an eternity. So what games are in this LLM? Can it do solitaire yet?
- westurner 2y ago
  It generates things that you get to look up citations for. It doesn't care if its output converges, it does what it wants differently every time.
  - TeMPOraL 2y ago
    > It generates things that you get to look up citations for. Why would you use it for that? Use a search engine. LLMs are substitute for talking to people. Use them for things you would ask someone else about, and then not follow up with searching for references.
- exe34 2y ago
  It can probably role-play.
- roywiggins 2y ago
  GPT-3.5 is pretty good at fabricating text adventures, I haven't tried any of the smaller models with that yet.
swores 2y ago
When I think about numbers like that it just seems (to me, and wrongly) like general progress that's not so crazy - the thought that really makes the speed of progress stand out to me is remembering when loading a single image - photo sized but not crazily high resolution - over dial-up was slow enough that you'd gradually see the image loading from top to bottom, and could see it gradually getting taller as more lines of pixels were downloaded and shown below the already loaded part. Contrasting that memory against the ability to now watch videos with much higher resolution per frame than those images were 30 years ago is what really makes me go "wow". For anyone not old enough to remember, here's an example on YouTube (and a faster loading time than I remember often being the case!): https://youtube.com/watch?v=ra0EG9lbP7Y https://youtube.com/watch?v=ra0EG9lbP7Y

It's truly amazing how quickly my browser loads 0.6GB of data. I remember when downloading a 1MB file involved phoning up a sysop in advance and leaving the modem on all night. We've come so far.

zozbot234 2y ago

You could more or less fit the full model on a single CD (or a DVD for the larger model sizes) but of course forget about trying to do inference for it on period hardware, it would be unusably slow.

doctorpangloss 2y ago

97MB for the Worms 3 demo felt like an eternity. So what games are in this LLM? Can it do solitaire yet?

westurner 2y ago
It generates things that you get to look up citations for. It doesn't care if its output converges, it does what it wants differently every time.
- TeMPOraL 2y ago
  > It generates things that you get to look up citations for. Why would you use it for that? Use a search engine. LLMs are substitute for talking to people. Use them for things you would ask someone else about, and then not follow up with searching for references.
exe34 2y ago
It can probably role-play.
roywiggins 2y ago
GPT-3.5 is pretty good at fabricating text adventures, I haven't tried any of the smaller models with that yet.

swores 2y ago

When I think about numbers like that it just seems (to me, and wrongly) like general progress that's not so crazy - the thought that really makes the speed of progress stand out to me is remembering when loading a single image - photo sized but not crazily high resolution - over dial-up was slow enough that you'd gradually see the image loading from top to bottom, and could see it gradually getting taller as more lines of pixels were downloaded and shown below the already loaded part. Contrasting that memory against the ability to now watch videos with much higher resolution per frame than those images were 30 years ago is what really makes me go "wow". For anyone not old enough to remember, here's an example on YouTube (and a faster loading time than I remember often being the case!): https://youtube.com/watch?v=ra0EG9lbP7Y https://youtube.com/watch?v=ra0EG9lbP7Y