4 ms·
Could you say a bit more about the link between prototypal inheritance and LLMs? Not obvious to me what it is.
by pkeenan11 2y ago
Could you say a bit more about the link between prototypal inheritance and LLMs? Not obvious to me what it is.
- Stwerner 2y agoAhh yeah - so I've found prototypal inheritance (or what Hofstadter calls The Prototype Principle) is a useful way to think about what's going on with in-context learning and few shot prompting and ways to take it further. If you provide a "prototype" to a model, you can operate on that prototype and create new instances or variations of it. This is useful for working with code by defining an abstraction or a class, and then having the LLM work with and modify it, generating new code that fits or inherits conceptually from that original prototype.