smoothyy

4 ms·

1. 1.▲
   by smoothyy 6mo ago

   The 20% is a safety margin on the memory fit check only. it sits on top of the raw weights-only figure (params × bytes-per-precision) to account for KV cache and activation tensors, not framework differences specifically. Your point is vali
2. 2.▲
   Show HN: Willitrun – check if any ML model runs on any device (benchmark-backed)(github.com)

   1 points by smoothyy 6mo ago|2 comments