3 ms·
There are several differences between LLMs and encyclopedias - LLMs don't need specific text about specific events in Chinese. They can be trained in text in En
by chrisdbanks 3y ago
There are several differences between LLMs and encyclopedias
- LLMs don't need specific text about specific events in Chinese. They can be trained in text in English and produce answers in Chinese via translation.
- LLMs probably need much more text to corrupt their veracity -- yet to be tested properly
- LLMs are more obfuscated in their purpose. If I'm sharing a text about a specific event then that is pretty damning, but if an LLM can answer questions about an event then you can't prove that was why I was sharing it. In fact it would be pretty hard to exclude information about specific events from an LLM