2 ms·Quantifying Long-Range Information for Long-Context LLM Pretraining Data2 points by PaulHoule 1y ago