3 ms·
See https://github.com/geerlingguy/beowulf-ai-cluster/issues/17 https://github.com/geerlingguy/beowulf-ai-cluster/issues/17 for more data — I didn't save all th
by geerlingguy 10mo ago
See https://github.com/geerlingguy/beowulf-ai-cluster/issues/17 https://github.com/geerlingguy/beowulf-ai-cluster/issues/17 for more data — I didn't save all the prompt processing times (Exo just outputs a time in ms, no other data for that), but will try to have another pass. Maybe also convince the Exo team to add a proper benchmarking capability ala `llama-bench` :)
- jonrouach 10mo agoor better, like you mentioned, try to convince Exo to develop in the open, so everyone gets any capability as PRs.
- geerlingguy 10mo agoThey are now, this morning they pushed all the code to the Exo repo, and archived the earlier Exo branch. We'll see how open they are now that whatever embargoed work they did with Apple is public..