3 ms·
If I was running in a server context, would the 50gb of ram be required to respond to one request, or can it be used to respond to multiple requests simultaneou
by iambateman 4y ago
If I was running in a server context, would the 50gb of ram be required to respond to one request, or can it be used to respond to multiple requests simultaneously?
- lolinder 4y agoI'm very late to this question, but I believe that that amount is only required once, but the context tensor will need to be created per request. I haven't confirmed that, though.
- boredemployee 4y agoI'd assume that all the calculations used for 1 request would already eat up that amount of memory, but I could be wrong!