3 ms·
"Note: using a 256k context window requires at least 64GB of memory. Using a 1M+ context window requires significantly more (100GB+)."
by tankado 2y ago
"Note: using a 256k context window requires at least 64GB of memory. Using a 1M+ context window requires significantly more (100GB+)."