2 ms·

Is it possible that with different hyperparameters, LLAMA 2 would be more faithful to the original? I'm pretty surprised that it would hallucinate anything majo

Is it possible that with different hyperparameters, LLAMA 2 would be more faithful to the original? I'm pretty surprised that it would hallucinate anything majorly different than the source material, since that task seems pretty "easy" for LLMs these days.

eigenvalue 3y ago
Yes, I'm sure there are ways to reduce the hallucination, though I don't know that these would all be accessible via the Python bindings. I think I might also be sampling too much from the model which is leading to it making up more stuff than normal. It's certainly an area I want to focus on more.