3 ms·
> One could spin this idea even further and train several models with radically different world views by curating different training corpi that represent differ
by trte9343r4 2y ago
> One could spin this idea even further and train several models with radically different world views by curating different training corpi that represent different sets of beliefs / world views.
You can get good results by combining different models in chat, or even the same model with different parameters. Model usually gives up on hallucinations when challenged. Sometime it pushes back and provides explanation with sources.
I have a script that puts models into dialog, moderates discussion and takes notes. I run this stuff overnight, so getting multiple choices speeds up iteration.