nikkindev

5 ms·

1. 1.▲
   by nikkindev 2y ago

   “Lazy self-installing Python scripts with uv”[1] article from Trey Hunner has more details with examples [1] https://treyhunner.com/2024/12/lazy-self-installing-python-s...
2. 2.▲
   by nikkindev 2y ago

   Author here: Wholeheartedly agree with your comment on hallucination. I initially set out to answer the question “Will entropy help identify hallucination?” And soon realised that it doesn’t, for the same reasons you mentioned above. So I p
3. 3.▲
   by nikkindev 2y ago

   Author here: Thanks for the explanation. Intuitively it does make sense that anything done during "post-training" (RLHF in our case) to make the model adhere to certain (set of) characteristics would bring the entropy down. It is
4. 4.▲
   by nikkindev 2y ago

   Author here: Really interesting work. Updated original post to include link to the paper. Thanks!
5. 5.▲
   by nikkindev 2y ago

   Author here: Yes. You are right. I was meaning to paint a picture that instead of the next token appearing magically, it is sampled from a probability distribution. The notion of determinism could be explained differently. Thanks for pointi
6. 6.▲
   by nikkindev 3y ago

   Not for self hosting. Self hosting [1] is still free since the code is open source. [1] https://ntfy.sh/install/