4 ms·
For a single execution, to a certain extent, yes. But that’s not the point I’m trying to make here. JIT compilers are vastly more predictable than LLMs. I can
by manuelabeledo 8mo ago
For a single execution, to a certain extent, yes.
But that’s not the point I’m trying to make here. JIT compilers are vastly more predictable than LLMs. I can take any two JVMs from any two vendors, and over several versions and years, I’m confident that they will produce the same outputs given the same inputs, to a certain degree, where the input is not only code but GC, libraries, etc.
I cannot do the same with two versions of the same LLM offering from a single vendor, that had been released one year apart.
- pjmlp 8mo agoGood luck mapping OpenJDK with Azul's cloud JIT, in generated machine code.
- manuelabeledo 8mo agoThe output being the actual program output, not the byte code. No one is arguing that in the scope of LLMs.