3 ms·
It's an interesting thought - but with the imprecise/random nature of LLMs, I wonder if we could tolerate something so inherently faulty / unreliable / human-li
by QuadrupleA 4y ago
It's an interesting thought - but with the imprecise/random nature of LLMs, I wonder if we could tolerate something so inherently faulty / unreliable / human-like in place of a compiler. If real compilers spit out subtle machine language bugs / mistranslations of code even 1% of the time, we'd be in big trouble.
- abraxas 4y agoThis may be at least partially circumvented by lowering the temperature of token generation. Otherwise, a strong set of tests should be generated to minimize the impact. The tooling is going to look very different. Every time we move up an abstraction layer we give up some guarantees from the underlying platform. The move to the cloud forced us to give up on having deterministic hardware. This is going to be a shift in that same direction. The lack of determinism causes problems to be sure but the payback is so great that it's likely to be a worthy tradeoff.