The context first bit doesn't even make sense. Transformers process their whole context window in parallel, unlike people who process it serially. There simply

The context first bit doesn't even make sense. Transformers process their whole context window in parallel, unlike people who process it serially. There simply is no place that gets processed "first". I'd love to see anyone who disagrees explain to me how that is supposed to work.