4 ms·
What's the feeling of playing with a powerful base model? Will it just complete the prompt text like a continuation of it?
by haolez 3y ago
What's the feeling of playing with a powerful base model? Will it just complete the prompt text like a continuation of it?
- MPSimmons 3y agoGenerally, yes, it literally just tries to predict the next token again and again and again. This model is apparently surprisingly good at chat, even though it is a base model, and will take part it it to some extent. It should be really interesting once it's fine-tuned.