3 ms·
Yeah, I'm not sure what the point of markdown is here either. I would expect that anything that looks remotely like a URL will be collected and scraped no matte
by autoexec 2y ago
Yeah, I'm not sure what the point of markdown is here either. I would expect that anything that looks remotely like a URL will be collected and scraped no matter what format it's in.
- jph00 2y agoContext windows for LLM inference are limited. You can't just throw everything into it -- it won't all fit, and larger amounts of context are slower and more expensive. So it's important to have a carefully curated set of well-formatted documents to work with.