om8

6 ms·

1. 61.▲
   by om8 2y ago

   Don't you think that LLM inference is already very democratic? Not saying that there is no room for improvements there -- there is still a lot to do in the space of speculative decoding, quantization and other stuff. I'm saying th
2. 62.▲
   by om8 2y ago

   P.S. They acknowledge this: “... our preliminary experiments show that such method might not be helpful, and even harmful, to open-ended text generation tasks. During generation, ∞-gram can make odd mistakes (e.g., predicting totally irrele
3. 63.▲
   by om8 2y ago

   Perplexity results are impressive. I wonder, how does combined models perform on MMLU and other problem-solving benchmarks. It can be that this infini-gram method is exactly the thing that “hacks” perplexity without adding any “understandin
4. 64.▲
   by om8 2y ago

   CLIP is a very interesting technology. On my previous job ML department created internal tool, where you could search through city panoramas (like google street view) using text. It could find you in a second all road pits, overfilled dumps