You do need more if you use larger context sizes though. It can really blow up to multiple times the model size even for 128k context. Edit: Oh I see that calc

You do need more if you use larger context sizes though. It can really blow up to multiple times the model size even for 128k context. Edit: Oh I see that calculator you linked shows that too. My information was more trial and error, thanks for the calculator link.