5 ms·

It requires mlx but it is an Apple silicon-only library as far as I can tell. How is it supposed to be (I quote) "iPhone, iPad, Android, Mac, Linux, pretty much

by ajnin 2y ago

It requires mlx but it is an Apple silicon-only library as far as I can tell. How is it supposed to be (I quote) "iPhone, iPad, Android, Mac, Linux, pretty much any device" ? Has it been tested on anything else than the author's MacBook ?

orsorna 2y ago
One of the maintainers has a video demo on his twitter claiming iOS, android and Linux. Some of the code is not released and I wish they were advertising that properly.
- tama_sala 2y ago
  The library already has tinygrad support it seems, so it's not limited to Apple & MLX
  - orsorna 2y ago
    That is true. However (as of two days ago, it may have rapidly changed since then) the python program did not differentiate based on your architecture and would try to import mlx regardless if it's installable on your system or not, causing import errors.
    - alexandercheema 2y ago
      This is fixed now, with these commits: - https://github.com/exo-explore/exo/commit/dbbc7be57fb1871d2b8f72ad345088ed86aec1fc https://github.com/exo-explore/exo/commit/dbbc7be57fb1871d2b... - https://github.com/exo-explore/exo/commit/ce46f000591d8d59c1c21fbec7b668ada65c5969 https://github.com/exo-explore/exo/commit/ce46f000591d8d59c1... Please keep the bug reports coming, we're moving fast to get this stable on all platforms.
lopuhin 2y ago
The README says they plan to add llama.cpp support which should cover a lot of targets, also they have tinygrad already integrated I think.
alexandercheema 2y ago
Repo maintainer here. It supports any device tinygrad does, which is a lot. We didn’t expect it to blow up so soon - the repo is still experimental. Internally we’ve mostly been testing on MacBooks and Mac Minis, and that’s where dev is happening. The swift implementation is outdated and currently broken, since Python has been changing so fast (over 20 commits in the last day). On my ToDo is CI/CD pipeline with integration tests for different device and network configurations, so we don’t randomly break stuff for certain devices. We’re moving fast to get it stable and usable. The goal is for this to be as simple as running Dropbox. Bear with us :)
- mikeqq2024 2y ago
  why there is no intel cpu/gpu support? it seems intel cpu/gpu is dead in AI community.

by ajnin 2y ago

orsorna 2y ago

One of the maintainers has a video demo on his twitter claiming iOS, android and Linux. Some of the code is not released and I wish they were advertising that properly.

tama_sala 2y ago
The library already has tinygrad support it seems, so it's not limited to Apple & MLX
- orsorna 2y ago
  That is true. However (as of two days ago, it may have rapidly changed since then) the python program did not differentiate based on your architecture and would try to import mlx regardless if it's installable on your system or not, causing import errors.
  - alexandercheema 2y ago
    This is fixed now, with these commits: - https://github.com/exo-explore/exo/commit/dbbc7be57fb1871d2b8f72ad345088ed86aec1fc https://github.com/exo-explore/exo/commit/dbbc7be57fb1871d2b... - https://github.com/exo-explore/exo/commit/ce46f000591d8d59c1c21fbec7b668ada65c5969 https://github.com/exo-explore/exo/commit/ce46f000591d8d59c1... Please keep the bug reports coming, we're moving fast to get this stable on all platforms.

lopuhin 2y ago

The README says they plan to add llama.cpp support which should cover a lot of targets, also they have tinygrad already integrated I think.

alexandercheema 2y ago

Repo maintainer here. It supports any device tinygrad does, which is a lot. We didn’t expect it to blow up so soon - the repo is still experimental. Internally we’ve mostly been testing on MacBooks and Mac Minis, and that’s where dev is happening. The swift implementation is outdated and currently broken, since Python has been changing so fast (over 20 commits in the last day). On my ToDo is CI/CD pipeline with integration tests for different device and network configurations, so we don’t randomly break stuff for certain devices. We’re moving fast to get it stable and usable. The goal is for this to be as simple as running Dropbox. Bear with us :)

mikeqq2024 2y ago
why there is no intel cpu/gpu support? it seems intel cpu/gpu is dead in AI community.