3 ms·
Confabulations are decreasing with newer models. I tested confabulations based on provided documents (relevant for RAG) here: https://github.com/lechmazur/confa
by zone411 2y ago
Confabulations are decreasing with newer models. I tested confabulations based on provided documents (relevant for RAG) here: https://github.com/lechmazur/confabulations/ https://github.com/lechmazur/confabulations/.
Note the significant difference between GPT-4 Turbo and GPT-4o.
- deleted 2y ago[deleted]
- tkgally 2y agoThat’s very interesting! Thanks for the link.
- christianqchung 2y agoIs 3% supposed to be significant? Or did you mean 4 Turbo and 4o mini?
- zone411 2y agoIt is significant because of the other chart that shows MUCH lower non-response rates for GPT-4o.