4 ms·
> a ∼3B-parameter on-device model
by Zee2 1y ago
> a ∼3B-parameter on-device model
- JKCalhoun 1y agoI was worried "device" was a Mac mini, not an iPhone. (I already have been running models on my MacBook Pro.)
- ThomasBb 1y agoThere are even already some local AFM to Open AI API bridge project on GitHub - that lets you point basically any Open AI compatible client at the local models. Super nice for basic summarisation and completions.