4 ms·
300GB of context for a single session is huge though. Modern local models max out at a whole lot less than that.
by zozbot234 5mo ago
300GB of context for a single session is huge though. Modern local models max out at a whole lot less than that.