3 ms·

The google collab link works if you replace the computed path to flax_model.msgpack on line 10 in load_params.py with ‘/content/pretrained/vqgan/flax_model.msgp

by jcims 4y ago

The google collab link works if you replace the computed path to flax_model.msgpack on line 10 in load_params.py with ‘/content/pretrained/vqgan/flax_model.msgpack’ Edit: actually it's easier to open a terminal and move /content/pretrained/vqgan to /content/min-dalle/pretrained/vqgan

kuprel 4y ago
Thanks for figuring this out. The problem was that the vqgan repository was being cloned to the wrong directory. The updated colab should work now
- DivineTraube 4y ago
  The updated version gives me this (after successful setup with the example alien thing): UnfilteredStackTrace Traceback (most recent call last) <ipython-input-2-0e20e3adf861> in <module>() 2 ----> 3 image = generate_image_from_text("alien life", seed=7) 4 display(image) 67 frames UnfilteredStackTrace: TypeError: lax.dynamic_update_slice requires arguments to have the same dtypes, got float16, float32. The stack trace below excludes JAX-internal frames. The preceding is the original exception that occurred, unmodified. -------------------- The above exception was the direct cause of the following exception: TypeError Traceback (most recent call last) /content/min-dalle/min_dalle/models/dalle_bart_decoder_flax.py in __call__(self, decoder_state, keys_state, values_state, attention_mask, state_index) 38 keys_state, 39 self.k_proj(decoder_state).reshape(shape_split), ---> 40 state_index 41 ) 42 values_state = lax.dynamic_update_slice( TypeError: lax.dynamic_update_slice requires arguments to have the same dtypes, got float16, float32.
  - jcims 4y ago
    You need to install flax 0.4.2. If you're using collab you just open a terminal (icon in the bottom left of the screen) and run: pip3 install flax==0.4.2
    - kuprel 4y ago
      Yes this is the fix for now. I need to address what is actually causing the dtype mismatch

by jcims 4y ago

kuprel 4y ago

Thanks for figuring this out. The problem was that the vqgan repository was being cloned to the wrong directory. The updated colab should work now

DivineTraube 4y ago
The updated version gives me this (after successful setup with the example alien thing): UnfilteredStackTrace Traceback (most recent call last) <ipython-input-2-0e20e3adf861> in <module>() 2 ----> 3 image = generate_image_from_text("alien life", seed=7) 4 display(image) 67 frames UnfilteredStackTrace: TypeError: lax.dynamic_update_slice requires arguments to have the same dtypes, got float16, float32. The stack trace below excludes JAX-internal frames. The preceding is the original exception that occurred, unmodified. -------------------- The above exception was the direct cause of the following exception: TypeError Traceback (most recent call last) /content/min-dalle/min_dalle/models/dalle_bart_decoder_flax.py in __call__(self, decoder_state, keys_state, values_state, attention_mask, state_index) 38 keys_state, 39 self.k_proj(decoder_state).reshape(shape_split), ---> 40 state_index 41 ) 42 values_state = lax.dynamic_update_slice( TypeError: lax.dynamic_update_slice requires arguments to have the same dtypes, got float16, float32.
- jcims 4y ago
  You need to install flax 0.4.2. If you're using collab you just open a terminal (icon in the bottom left of the screen) and run: pip3 install flax==0.4.2
  - kuprel 4y ago
    Yes this is the fix for now. I need to address what is actually causing the dtype mismatch