3 ms·
It's useless before the model gets instruction and preference tunings. Won't even follow a simple ask, it will just assume it is a list of questions and generat
by visarga 4y ago
It's useless before the model gets instruction and preference tunings. Won't even follow a simple ask, it will just assume it is a list of questions and generate more, or continue with slightly related comments.
FB trained a LLaMA-I (instruction tuned) variant for sports, just to show they can, but I don't think it got released.
- ShamelessC 4y agoUseless!? C'mon.
- ma2rten 4y agoIt's still useful, but you need to know how to use it.
- notpushkin 4y agoSo, you need to know how to tune it.
- qingdao99 4y agoSurely it would work with a format like: User: <question or task> Assistant:
- cfcf14 4y agoYou have to prompt it correctly, non-instruction-aligned models don't behave like agent simulators by default.
- RugnirViking 4y agoit's not that useless, you just have to prompt it the right way (usually by offering an example of the kind of output you want)
- skhm 4y agoTry giving it a simple request instead ;)