4 ms·
There's also prior art. Or probably, anyways. https://www.reddit.com/r/LocalLLaMA/comments/1wijo3e/i_literally_built_the_jev_architecture_one_year/ https://www
by cmrdporcupine 15d ago
There's also prior art. Or probably, anyways.
https://www.reddit.com/r/LocalLLaMA/comments/1wijo3e/i_literally_built_the_jev_architecture_one_year/ https://www.reddit.com/r/LocalLLaMA/comments/1wijo3e/i_liter...
Not only is it replicable as you say, things like it already exist(ed).
The important bit of course is in the actual implementation: a) models fine tuned to produce good results for these types of questions and b) runtimes optimized to do this quickly and at scale