> I feel like this just killed a few small startups who were trying to offer more context. Those startups killed themselves. A 32K context was advertised as a

> I feel like this just killed a few small startups who were trying to offer more context. Those startups killed themselves. A 32K context was advertised as a feature to be rolled out the same day GPT-4 came out. Also - what startups are getting even remotely close to 32K context at GPT-4’s parameter count? All I’ve seen is attempts to use KNN over a database to artificially improve long term recall.