3 ms·
So is the output compared to the embedding vectors (via dot product) and the strongest one output its token? How is it "clocked" to get successive tokens?
by phkahler 4y ago
So is the output compared to the embedding vectors (via dot product) and the strongest one output its token? How is it "clocked" to get successive tokens?
- vore 4y agoGPT is autoregressive, so it uses the previously generated output to produce the next prediction.
- sebzim4500 4y ago> So is the output compared to the embedding vectors (via dot product) and the strongest one output its token? Yeah except it doesn't necessarily take the strongest one, you can set a 'temperature' parameter which determines how often you should pick the second choice, etc. >How is it "clocked" to get successive tokens? You add each new token to the input prompt to generate the next one.
- phkahler 4y ago>> You add each new token to the input prompt to generate the next one. OMFG so it really is a super advanced auto-complete!! Yeah, this is not AGI or anywhere close. That explains how it picks up context, and also how it can lose the plot after a bit due to limited input size.