4 ms·
Nice! I'm interested in your cubecl-wgpu patches. I've been struggling to get lower than FP32 safetensor models working on burn, did you write the patches to c
by scronkfinkle 8mo ago
Nice!
I'm interested in your cubecl-wgpu patches. I've been struggling to get lower than FP32 safetensor models working on burn, did you write the patches to cubecl-wgpu to get around this restriction, to add support for GGUF files, or both?
I've been working on something similar, but for whisper and as a library for other projects: https://github.com/Scronkfinkle/quiet-crab https://github.com/Scronkfinkle/quiet-crab
- adefa 8mo agoThe cubecl-wgpu were only needed to reduce the number of kernel workgroups, otherwise I was getting errors in WASM.