The lost-in-the-middle phenomenon makes me _not_ want larger context windows because the model cannot effectively use it. It seems like we need another arch to

The lost-in-the-middle phenomenon makes me _not_ want larger context windows because the model cannot effectively use it. It seems like we need another arch to process large ctx size.