3 ms·

> Memory Boost for LLM Capacity Requirements: 128 gigabytes (GB) of HBMe2 memory capacity, 3.7 terabytes (TB) of memory bandwidth ... I didn't know "terabytes

> Memory Boost for LLM Capacity Requirements: 128 gigabytes (GB) of HBMe2 memory capacity, 3.7 terabytes (TB) of memory bandwidth ... I didn't know "terabytes (TB)" was a unit of memory bandwidth...

throwup238 3y ago
It’s equivalent to about thirteen football fields per arn if that helps.
gnabgib 3y ago
Bit of an embarrassing typo, they do later qualify it as 3.7TB/s
- SteveNuts 3y ago
  Most of the time bandwidth is expressed in giga/gibi/tera/tebi bits per second so this is also confusing to me
  - sliken 3y ago
    Only for networking, not for anything measured inside a node. Disk bandwidth, cache bandwidth, and memory bandwidth is nearly always measured in bytes/sec (bandwidth), or NS/cache line or similar (which is mix of bandwidth and latency).
  - deleted 3y ago
    [deleted]
nahnahno 3y ago
About as relevant a measure of speed as parsecs