4 ms·
There's really only two choices in terms of laptop: a built in discrete GPU aka a gaming laptop, or one with the ability to add an external GPU through Thunderb
by benoau 1y ago
There's really only two choices in terms of laptop: a built in discrete GPU aka a gaming laptop, or one with the ability to add an external GPU through Thunderbolt or OCuLink.
Pretty much any desktop is going to outperform a laptop, especially the GPU.
- zyruh 1y agoSuper helpful - thank you!
- brudgers 1y agoWorkstation laptops can be specified with powerful GPU’s. You can spend $10k on a Dell with 4 drive capability, 128gb of ram and 24gb of gpu.
- dankwizard 1y agoYes but then you have a laptop edition card which will just never compete with desktop.
- LorenDB 1y agoExternal GPU is actually a really good option here. Get a laptop with a beefy CPU (definitely Ryzen; Strix Halo chips are really good and would be decent at standalone AI as well) and Thunderbolt/Oculink, then grab an eGPU dock and get the best GPU you can afford. For gaming, eGPUs suffer from bandwidth constraints, but for LLMs it shouldn't matter as much since the model only needs loaded once; after that it can sit in VRAM.
- zyruh 1y agoThis is great - thank you!
- zyruh 1y agoThank you!