Am I right in my layman's understanding that context windows scaling up requires (mainly) much more compute at run time? Or do longer context models require dif

Am I right in my layman's understanding that context windows scaling up requires (mainly) much more compute at run time? Or do longer context models require different/longer training?