4 ms·
If you think that LLMs have basically two properties: habitability to use natural language and knowledge to answer questions, then Small language models should
by dlojudice 3y ago
If you think that LLMs have basically two properties: habitability to use natural language and knowledge to answer questions, then Small language models should being seen just excellent at natural language, and that's great because for many tasks general knowledge is not needed, specially for RAG.
- ethbr1 3y agoWhich more or less mirrors human learning edges. If someone read a set of dictionaries, but then talked to actual people... you'd get about the same. E.g. complete obliviousness to colloquialisms, etc.