3 ms·
Having ever increasing context is not the silver bullet. For those who believe that the larger the context, the smarter the model, you will find the model still
by vissidarte_choi 3y ago
Having ever increasing context is not the silver bullet. For those who believe that the larger the context, the smarter the model, you will find the model still talking nonsense even if it were fed with much larger context.
- vissidarte_choi 3y agoEven if it were equipped with infinite context, a user cannot dump everything into the conext. For enterprise users, their data volumn can be up to trillion Bytes, and cannot be measured by the number of tokens.
- Someone1234 3y agoSure; but before you couldn't even use it for some problems because the problems were bigger than the context window. For example, I was trying to generate an XSLT 3.0 transformation from one Json format to another. The two formats and description alone almost depleted my context window. In essence, it killed using GPT-4 for this project. I use it daily, and I haven't had it spit out too much "nonsense" in spite of everyone constantly telling me how that's all it does. The quality of results are on-par with Stackoverflow (in good and bad ways).