3 ms·
Why can't you just omit all modern content related to physics? There's lots of training data that doesn't mention any of Einstein's work.
by Teever 2y ago
Why can't you just omit all modern content related to physics? There's lots of training data that doesn't mention any of Einstein's work.
- staticman2 2y agoMaybe you could, but any influence these concepts had on general culture might still leak in.
- Teever 2y agoTo me that's an interesting feature, not necessarily a bug. How much would have to leak in to guide the LLM to the right conclusions? Is it a matter of quantity or quality? Can we successfully eliminate all leakage?