3 ms·
This 1000%. Data centres don't equate to medium sized labs and businesses. A stack of Macs is up and running without digging trenches, an electrician on staff a
by _hugerobots_ 14d ago
This 1000%. Data centres don't equate to medium sized labs and businesses. A stack of Macs is up and running without digging trenches, an electrician on staff and a department of PhDs to justify the spend.
- bigyabai 14d agoIt's likely that a stack of Macs will draw more power for slower prefill/decode than equivalently priced Nvidia GPUs. If power efficient inference is the goal, Macs are a non-starter.
- _hugerobots_ 14d agoSo if it isn't a comparative ability, now it's a power cost issue? This reads like goal post moving.