3 ms·
Can you suggest any good llms for cpu?
by ydu1a2fovb 8mo ago
Can you suggest any good llms for cpu?
- R_D_Olivaw 8mo agoFollowing.
- LTL_FTC 8mo agoI started off using gpt-oss-120b on cpu. It uses about 60-65gb of memory or so but my workstation has 128gb of ram. If I had less ram, I would start off with the gpt-oss-20b model and go from there. Look for MoE models as they are more efficient to run.
- Aerbil313 8mo agoHey Olivaw, saw a comment of yours asking about planners. Wanted to reply but it’s expired. Check out bullet journalling.
- R_D_Olivaw 8mo agoThanks for the reply! Bullet journaling is neat, but I'm far too whacky with my notes to stick to that kind of structure. I have various other structures I implement, but they're just hodge podges of things.
- LTL_FTC 8mo agoI started off using gpt-oss-120b on cpu. It uses about 60-65gb of memory or so but my workstation has 128gb of ram. If I had less ram, I would start off with the gpt-oss-20b model and go from there. Look for MoE models as they are more efficient to run.