3 ms·
But that still makes it great for RAG applications, where I want the answer to be based on my data, not on whatever it learned from the web.
by rolisz 3y ago
But that still makes it great for RAG applications, where I want the answer to be based on my data, not on whatever it learned from the web.
- monkeydust 3y agoInteresting. Anyone tried / benchmarked this for RAG?
- refulgentis 3y agoyeah it's good. you'd want* to finetune this before using it (c.f. my reply to it's depressed and insults me for no reason whatsover? @ https://huggingface.co/microsoft/phi-2/discussions/61 https://huggingface.co/microsoft/phi-2/discussions/61) * by want, I mean need. People self-peasantized heavily on "censorsed models" and don't really understand how these work, and the SNR is out of wack because there's a 100000x more waifu creators and culture warriors than knowledgable people sharing on this subject