3 ms·
> And it gets churned by every single request they receive It gets pretty efficiently cached, but does eat the context window and RAM.
by cma 6mo ago
> And it gets churned by every single request they receive
It gets pretty efficiently cached, but does eat the context window and RAM.