4 ms·

what's the inference time on M1?

tomduncalf 4y ago
Running the "alien life" example from the README took 30 seconds on my M1 Max. I don't think it uses the GPU at all. I couldn't get the "mega" option to work, I got an error "TypeError: lax.dynamic_update_slice requires arguments to have the same dtypes, got float32, float16" (looks like a known issue https://github.com/kuprel/min-dalle/issues/2 https://github.com/kuprel/min-dalle/issues/2) Edit: installing flax 0.4.2 fixes this issue, thank all!
- klohto 4y ago
  The thread now has a fix. As for the GPU, it's possible to get it working with some extra steps https://github.com/google/jax/issues/8074 https://github.com/google/jax/issues/8074 Macbook Pro M1 Pro numbers (CPU): python3 image_from_text.py --text='court sketch of godzilla on trial' --mega 640.24s user 179.30s system 544% cpu 2:30.39 total
  - tomduncalf 4y ago
    Pretty much identical on M1 Max python3 image_from_text.py --text='a comfy chair that looks like an avocado' 612.30s user 180.72s system 552% cpu 2:23.52 total
  - tomduncalf 4y ago
    From reading that thread it didn't sound like GPU was fully supported yet, were you able to get it working?
    - deleted 4y ago
      [deleted]
- NhanH 4y ago
  Change the flax version to 0.4.2 (currently 0.5.2) will work So much for semver :(
  - Twisol 4y ago
    0.y.z is kind of an "all bets are off" situation in semver: https://semver.org/#spec-item-4 https://semver.org/#spec-item-4 > Major version zero (0.y.z) is for initial development. Anything MAY change at any time. The public API SHOULD NOT be considered stable. Variant schemes like the one respected by Cargo (https://doc.rust-lang.org/cargo/reference/semver.html https://doc.rust-lang.org/cargo/reference/semver.html) aren't usually much different. > Initial development releases starting with "0.y.z" can treat changes in "y" as a major release, and "z" as a minor release.
- lloeki 4y ago
  This appears to have been fixed moments ago: https://github.com/kuprel/min-dalle/commit/38ebe54a382f36dc7090b69f632d355310108701 https://github.com/kuprel/min-dalle/commit/38ebe54a382f36dc7...
- kuprel 4y ago
  Thanks for catching this. I just updated it so that it should work with the latest flax.

Running the "alien life" example from the README took 30 seconds on my M1 Max. I don't think it uses the GPU at all. I couldn't get the "mega" option to work, I got an error "TypeError: lax.dynamic_update_slice requires arguments to have the same dtypes, got float32, float16" (looks like a known issue https://github.com/kuprel/min-dalle/issues/2 https://github.com/kuprel/min-dalle/issues/2) Edit: installing flax 0.4.2 fixes this issue, thank all!

klohto 4y ago
The thread now has a fix. As for the GPU, it's possible to get it working with some extra steps https://github.com/google/jax/issues/8074 https://github.com/google/jax/issues/8074 Macbook Pro M1 Pro numbers (CPU): python3 image_from_text.py --text='court sketch of godzilla on trial' --mega 640.24s user 179.30s system 544% cpu 2:30.39 total
- tomduncalf 4y ago
  Pretty much identical on M1 Max python3 image_from_text.py --text='a comfy chair that looks like an avocado' 612.30s user 180.72s system 552% cpu 2:23.52 total
- tomduncalf 4y ago
  From reading that thread it didn't sound like GPU was fully supported yet, were you able to get it working?
  - deleted 4y ago
    [deleted]
NhanH 4y ago
Change the flax version to 0.4.2 (currently 0.5.2) will work So much for semver :(
- Twisol 4y ago
  0.y.z is kind of an "all bets are off" situation in semver: https://semver.org/#spec-item-4 https://semver.org/#spec-item-4 > Major version zero (0.y.z) is for initial development. Anything MAY change at any time. The public API SHOULD NOT be considered stable. Variant schemes like the one respected by Cargo (https://doc.rust-lang.org/cargo/reference/semver.html https://doc.rust-lang.org/cargo/reference/semver.html) aren't usually much different. > Initial development releases starting with "0.y.z" can treat changes in "y" as a major release, and "z" as a minor release.
lloeki 4y ago
This appears to have been fixed moments ago: https://github.com/kuprel/min-dalle/commit/38ebe54a382f36dc7090b69f632d355310108701 https://github.com/kuprel/min-dalle/commit/38ebe54a382f36dc7...
kuprel 4y ago
Thanks for catching this. I just updated it so that it should work with the latest flax.