3 ms·
Small open source models shouldn't be used for world knowledge, that's not their purpose.
by mediaman 3mo ago
Small open source models shouldn't be used for world knowledge, that's not their purpose.
- Petersipoi 3mo agoWhy not? Seems like a cop out. Being able to ask questions to small open models seems.... obviously useful?
- mediaman 3mo agoBecause they don't have a lot of parameters to store general Wikipedia knowledge. They're small. Use big models that have high parameter capacity to store general information. Or build a harness around the small model that searches a knowledge base/internet. Use the right tool for the job. It's like asking why a screwdriver isn't good at sawing wood, or calling C a terrible language because it's hard to make CRUD apps with it.