3 ms·
How do you take a raw model and use it without chatting ? Asking as a layman
by CGMthrowaway 11mo ago
How do you take a raw model and use it without chatting ? Asking as a layman
- behnamoh 11mo agothe same way we used GPT-3. "the following is a conversation between the user and the assistant. ..."
- nrhrjrjrjtntbt 11mo agoOr just: 1 1 2 3 5 8 13 Or: The first president of the united
- CGMthrowaway 11mo agoAnd that's better? Isn't that just SMS autocomplete?
- d-lisp 11mo agoIf that's SMS autocomplete, then chatLLMs are just SMS autocomplete with sugar on top.
- CGMthrowaway 11mo agoThat's what I have always thought. SMS autocomplete with more intermediate iteration and better source data compression
- nrhrjrjrjtntbt 11mo agoBetter? I am not sure. A parent comment [1] was suggesting better LLM performance using completion than using chat. UX wise it is probably worse except for power users. [1] https://news.ycombinator.com/item?id=46113298 https://news.ycombinator.com/item?id=46113298
- roywiggins 11mo agoGPT3 was originally just a completion model. You give it some text and it produced some more text, it wasn't tuned for multi-turn conversations. https://platform.openai.com/docs/api-reference/completions/create https://platform.openai.com/docs/api-reference/completions/c...
- swatcoder 11mo agoYou lob it the beginning of a document and let it toss back the rest. That's all that the LLM itself does at the end of the day. All the post-training to bias results, routing to different models, tool calling for command execution and text insertion, injected "system prompts" to shape user experience, etc are all just layers built on top of the "magic" of text completion. And if your question was more practical: where made available, you get access to that underlying layer via an API or through a self-hosted model, making use of it with your own code or with a third-party site/software product.