How on earth do they handle large historical context windows for these chatbots? Surely they'd have to remember more than the last 50k context to have any mean

How on earth do they handle large historical context windows for these chatbots? Surely they'd have to remember more than the last 50k context to have any meaningful value to people?