4 ms·
My problem is how hot they run. I'm on an m4 pro. Do you have the same issue?
by prettyblocks 1mo ago
My problem is how hot they run. I'm on an m4 pro. Do you have the same issue?
- downrightmike 1mo agoMineral oil bath?
- deleted 1mo ago[deleted]
- datadrivenangel 1mo agojust decent air cooling and you'll be okay. it will get up to 75/80C though for my M5 MBP.
- lukan 1mo agoI don't have the hardware but a often mentioned advice is to put your mac into energy saving mode - it still will work, a bit slower, but stays cool.
- PalmPilotProMax 1mo agoImagine spending all that money on Apple hardware only to throttle it to a fraction of its performance lol Steve Jobs would be proud. People really are holding their Apple hardware wrong.
- deleted 1mo ago[deleted]
- jonplackett 1mo agoIt’s hot and also LOUD and runs the battery down quick. But I’m having a lot of luck just running things when I’m away from the computer and can leave it plugged in. It starts going weird (unreliable and slow) with context over 80k so you have to pick tasks one at a time and baby sit a lot more than Claude. But it really is very capable and feels like there’s an intelligence there to talk to. Maybe gpt-4 level clever? I have an m5 max 64gb and I think anything slower would be quite painful.
- seanmcdirmid 1mo agoI have an m3 max 64GB and it runs ok, I was playing around with it last night. Its reasoning is better, but the token/s still makes an MoE model (35B A3B) preferable so I switched back. Try using Goose instead of Claude's harness? Goose doesn't load as much context in at the start, so it might be more usable. I've definitely been able to get it past 128K, although I typically don't go beyond 70-80k. MoE might also be better at this.
- coldtea 1mo ago>It’s hot and also LOUD and runs the battery down quick. Who'd run this on battery? Or do you mean kills the battery faster even when used while charging?
- jonplackett 1mo agoI was trying to do some work on the train with no signal.
- coldtea 1mo agoCouldn't you just enjoy the ride?
- LeifCarrotson 1mo agoThere was a lovely window of a few years when processors were fast enough and low-power enough that real development work could trivially happen on a Macbook Air in a lounge. That window is waning as more and more memory and graphics processing power is being used locally. I suppose the future is most likely going to involve farming out AI requests to your desktop machine, your company's compute farm, or a cloud endpoint, but if you're expecting to run an AI offline on your lap with a battery...your lap will get warm.
- dmitrygr 1mo agoNo idea what you are talking about. My battery lasts longer than ever while running vim and make and GCC. It’s amazing. Not sure why your windows are closing.
- ls612 1mo agoI tested Gemma 4 a couple months ago and yes it ramps the fans to max. Definitely a thing that should only be done on wall power.
- akg_67 1mo agoMacs fan control set to full blast and lifting the Mac above table for air circulation across bottom. I use M1 Max with qwen3.8 27b mlx. The gpu temp can reach easily to 95°C as fan doesn’t kick in automatically until 90°C. With Macs fan control at full blast and MBP off table, temp usually hover around 85°C.
- Footprint0521 1mo agoJust curious, what is your ram and how many tokens per second do you get with that?
- Forgeties79 1mo agoYikes isn’t 95 well above the danger zone for most components or have things changed? I remember crypto mining in the early 2010’s and making sure to stay under 85C on my GPU.
- walrus01 1mo agoIf you're going to try to use a mac laptop for long term inference you'll probably want to buy one of those $30 laptop fan cooling pads (sold for absurd sized 17 inch x86-64 gaming laptops) on Amazon. Otherwise you'll roast the battery over time and significantly hurt its cycle life and capacity. If you can get significant airflow under the laptop that'll help a lot.
- nicce 1mo agoHaving a server in the basement helps a lot :-D Then tailscale from everywhere.