2 ms·
300bn weights, at 4bytes/weight is 1.2TB
by mjburgess 4y ago
300bn weights, at 4bytes/weight is 1.2TB
- Epa095 4y agoYes, but how does it remember the stuff you told it earlier in the conversation? Those 1.2TB is the trained model, and I assume that those weights are not changed by the conversation?
- bryan0 4y agoI believe that the previous input, from earlier in the conversation, is always prepended to the new input.