3 ms·
Falcon 40B is allegedly the closest thing out there. It sure beats the hell out of all the other open source models I've tried, but good luck finding hardware t
by jdm2212 3y ago
Falcon 40B is allegedly the closest thing out there. It sure beats the hell out of all the other open source models I've tried, but good luck finding hardware that can run it.
- ls612 3y agoHow much unified memory would you need to run this on an Apple silicon Mac?
- jdm2212 3y agoSome discussion of trying to get it to run, if you're curious what folks have been trying: https://www.reddit.com/r/LocalLLaMA/comments/13wutj4/getting_falcon_40b_to_work/ https://www.reddit.com/r/LocalLLaMA/comments/13wutj4/getting...