3 ms·How large would a 1 billion token kv even be ?!by AureliusMA 5mo agoHow large would a 1 billion token kv even be ?!AntiUSAbah 5mo ago30TB for 4 bit, 60tb for 8bit res