2 ms·

I agree with you though, the title is misleading.

• BoorishBears 2y ago
  Title is perfect. Their typical audience probably understands "memory" better than "context window", but then if you've actually deployed these systems it's not difficult to go the other way, from "memory" to "context window" since the context window specifically is known to take additional VRAM over the model itself