4 ms·
Could they even afford 4B dense parameters touching every token? That seems like a LOT of compute compared to generating the classic Google SERP.
by anon373839 3mo ago
Could they even afford 4B dense parameters touching every token? That seems like a LOT of compute compared to generating the classic Google SERP.