3 ms·Unsure but yes most likely they use YaRN, and maybe trained a bit more on long context maybe (or not)by danielhanchen 8mo agoUnsure but yes most likely they use YaRN, and maybe trained a bit more on long context maybe (or not)