yecomb

4 ms·

1. 1.▲
   Dissecting Batching Effects in GPT Inference(le.qun.ch)

   3 points by yecomb 3y ago|0 comments
2. 2.▲
   by yecomb 4y ago

   huggingface would save a lot of money if they know this :)