23 ms·
In that vein, how about stackoverflow? That should give at least straightforward ask-and-answer format, and there's plenty on material to work with.
by Faint 4y ago
In that vein, how about stackoverflow? That should give at least straightforward ask-and-answer format, and there's plenty on material to work with.
- dchest 4y agoLlaMa was trained on 78 GB of StackExchange (I assume StackOverflow was included in that).
- int_19h 4y agoBut was it parsed and reformatted specifically in the "chat format" (i.e. the same as inputs later fed to the model when used as a chatbot)? It can make a surprisingly big difference.