I don’t see how any toy model you could trivially create could have the settings / tweaks for 100k context windows applied / played with. I mean, in general ye

I don’t see how any toy model you could trivially create could have the settings / tweaks for 100k context windows applied / played with. I mean, in general yes, but in this specific example? Hmm…