3 ms·
Did you play around with the temperature and the Top P settings? Adjusting those can vary the output quite a bit. I also think "prompt engineering" is a real ar
by throwaway4aday 4y ago
Did you play around with the temperature and the Top P settings? Adjusting those can vary the output quite a bit. I also think "prompt engineering" is a real art and not just a fancy name. If you can land on the right set of keywords and instructions it seems like you can explore uncommon areas of the model. I haven't tried fine tuning the model yet but from looking at other projects people are working on that use fine tuning it seems like you can get the model to act in a certain way more consistently by doing so. It just seems like a pain to generate all of the example prompts and responses.