kerbal

4 ms·

1. 1.▲
   Alpaca Libre – CC0 instruction fine-tuning tasks – 55k so far(github.com)

   3 points by kerbal 4y ago|0 comments
2. 2.▲
   by kerbal 4y ago

   Same impression here. Rolling my own to learn more in the process.
3. 3.▲
   by kerbal 4y ago

   What I really don’t like is the fact that the new chat endpoint doesn’t have the logprobs option. For InstructGPT models you can view token probability but for newer models you cannot - another thing that “Open”AI decided that we shouldn’t
4. 4.▲
   by kerbal 4y ago

   Oh, yes - in my tests it worked better most of the time but there were some cases where the results were worse. Regarding the “pyramids” - I think it might work better with actual questions.
5. 5.▲
   by kerbal 4y ago

   Exactly. The fake (hypothetical) answer is usually longer than the question and often contains words that match the real answer even when the domain of question and answer is different ie “how to get out of jail?” asked in the context of mo
6. 6.▲
   by kerbal 4y ago

   I’ve also used similar approach to build Q&A system for PDF files (my main use case - board game manuals). OpenAIs embeddings are nice to play with. Also there is an easy technique for getting better results with dense search - Hypothet