4 ms·
yep, pretty much what i'm saying here. Though not all language models are built the same, eg the inference cost is unique to it due to its size. Still, most of
by andreyk 5y ago
yep, pretty much what i'm saying here. Though not all language models are built the same, eg the inference cost is unique to it due to its size. Still, most of this applies to any typical language model.