4 ms·
Wow, what a nightmare of a non-deterministic bug introducing library. Super fun idea though, I love the concept. But I’m getting the chills imagining the havoc
by turbocon 1y ago
Wow, what a nightmare of a non-deterministic bug introducing library.
Super fun idea though, I love the concept. But I’m getting the chills imagining the havoc this could cause
- userbinator 1y agoIt's like automatically copy-pasting code from StackOverflow, taken to the next level.
- deleted 1y ago[deleted]
- extraduder_ire 1y agoAre there any stable output large language models? Like stablediffusion does for image diffusion models.
- tibbar 1y agoIf you use a deterministic sampling strategy for the next token (e.g., always output the token with the highest probability) then a traditional LLM should be deterministic on the same hardware/software stack.
- roywiggins 1y agoDeterministic is one thing, but stable to small perturbations in the input is another.
- dragonwriter 1y ago> Deterministic is one thing, but stable to small perturbations in the input is another. Yes, and the one thing that was asked about was "deterministic" not "stable to small perturbations in the input.
- extraduder_ire 1y agoWouldn't seeding the RNG used to pick the next token be more configurable? How would changing the hardware/other software make a difference to what comes out of the model?
- tibbar 1y ago> Wouldn't seeding the RNG used to pick the next token be more configurable? Sure, that would work. > How would changing the hardware/other software make a difference to what comes out of the model? Floating point arithmetic is not entirely consistent between different GPUs/TPUs/operating systems.
- emporas 1y agoIt imports the bugs as well. No human involvement needed. Automagically.
- 3abiton 1y agoSounds like a fun way to learn effective debugging.
- anilakar 1y agoDidn't someone back in the day write a library that let you import an arbitrary Python function from Github by name only? It obviously was meant as a joke, but with AIcolytes everywhere you can't really tell anymore...
- atoav 1y agoWhy not go further? Just expose a shell to the internet and let them do the coding work for you /s
- bolognafairy 1y ago“Twitch does…”
- dheera 1y agoIt's not really something to be sarcastic about. I've actually done this, setting aside a virtual machine specifically for the purpose, trying to move a step towards a full-blown AI agent.
- marssaxman 1y agoWhy on earth did you want to do that?
- __alexs 1y agoThere's one that loads code out of the best matching SO answer automatically https://github.com/drathier/stack-overflow-import https://github.com/drathier/stack-overflow-import
- rollcat 1y agoFlask also started as an April 1st joke, in response to bottle.py but ever so slightly more sane. It gathered so much positive response, that mitsuhiko basically had to make it into a real thing, and later regretted the API choices (like global variables proxying per-request objects).
- tilne 1y agoIs there somewhere I can read about those regrets?
- QQ00 1y agoI second this, I need to know more. programming lore is my jam.
- rollcat 1y agoTwo days after the announcement: https://lucumr.pocoo.org/2010/4/3/april-1st-post-mortem/ https://lucumr.pocoo.org/2010/4/3/april-1st-post-mortem/ I think there was another, later retrospective? Can't find it now.
- dheera 1y agoI mean, we're at the very early stages of code generation. Like self-driving cars and human drivers, there will be a point in the future when LLM-generated code is less buggy than human-generated code.
- AlotOfReading 1y agoThat's a compiler with more steps.