4 ms·
I don't worry about bandwidth or constant CPU use, but the one thing that will kill my mac is burning out the SSD. The calculator gives numbers for nearly ever
by BuildTheRobots 6mo ago
I don't worry about bandwidth or constant CPU use, but the one thing that will kill my mac is burning out the SSD.
The calculator gives numbers for nearly everything, but I can't obviously see how much space it needs for model storage or how many writes of temp files I should expect if I'm running flat out.
- sleepybrett 6mo agoput that stuff on an external disk perhaps, it will eventually crater, but it's easier to replace than macbook internal storage (how are they doing mac minis these days?)
- neurostimulant 6mo agoIsn't high memory pressure will result in high memory paging which will wear down the internal ssd?
- MithrilTuxedo 6mo agoI assumed you'd want to run one immutable model that can fit in memory without any temp files.