3 ms·
Title is perfect. Their typical audience probably understands "memory" better than "context window", but then if you've actually deployed these systems it's not
by BoorishBears 2y ago
Title is perfect. Their typical audience probably understands "memory" better than "context window", but then if you've actually deployed these systems it's not difficult to go the other way, from "memory" to "context window" since the context window specifically is known to take additional VRAM over the model itself