2 ms·
> Context requires quadratic VRAM Even if this is not solved, there is so much economic benefit, tens of TBs of VRAM will become feasible.
by dist-epoch 2y ago
> Context requires quadratic VRAM
Even if this is not solved, there is so much economic benefit, tens of TBs of VRAM will become feasible.