3 ms·
By a transformer I essentially mean a model (probably LLM) that operates on a context-window of tokens by appending a new token and then shifting. If I underst
by golol 4y ago
By a transformer I essentially mean a model (probably LLM) that operates on a context-window of tokens by appending a new token and then shifting.
If I understand correctly the solution you give would be an example of what I mean by using prompt engineering to solve the problem. It is like building a meta model using a transformer.