3 ms·
If you train a LLM to compile, you probably also want to set the randomness to zero, if that is the case you’ve just “brute forced” an actual compiler
by m3kw9 3y ago
If you train a LLM to compile, you probably also want to set the randomness to zero, if that is the case you’ve just “brute forced” an actual compiler
- danielmarkbruce 3y agoyou don't want a creative compiler?
- fxcao 3y agoIn this specific use case I think we should avoid any creative aspect in the behavior of the LLM. Compiling might look like a "word-for-word" translation in a certain manner. Isn't it ?
- layer8 3y agoI see no inherent conflict between creativity and determinism. You could give the compiler a seed value to perturbate the solution space.
- m3kw9 3y agoWhy vote down a rhetorical question?