3 ms·
> So is the output compared to the embedding vectors (via dot product) and the strongest one output its token? Yeah except it doesn't necessarily take the stro
by sebzim4500 4y ago
> So is the output compared to the embedding vectors (via dot product) and the strongest one output its token?
Yeah except it doesn't necessarily take the strongest one, you can set a 'temperature' parameter which determines how often you should pick the second choice, etc.
>How is it "clocked" to get successive tokens?
You add each new token to the input prompt to generate the next one.
- phkahler 4y ago>> You add each new token to the input prompt to generate the next one. OMFG so it really is a super advanced auto-complete!! Yeah, this is not AGI or anywhere close. That explains how it picks up context, and also how it can lose the plot after a bit due to limited input size.