3 ms·
Can Reflection:70b work on them?
by cranberryturkey 2y ago
Can Reflection:70b work on them?
- angoragoats 2y agoMaybe you meant to reply to a different comment? Work on what? Edit: I guess to directly answer your question, I don’t see why you couldn’t run a 70b model at full quality on either a M2 192GB machine or on an 8x 3090 setup.
- christianqchung 2y agoPretty sure it'll work where any 70b model would, but it's probably not noticably better than Llama 3.1 70b if the reports I'm reading now are correct.[1] [1]https://x.com/JJitsev/status/1832758733866222011 https://x.com/JJitsev/status/1832758733866222011