3 ms·
I ported inference of couple open-source models from Torch/Python/CUDA into D3D11 compute shaders which runs on all 3D GPUs not just on nVidia. Whisper was the
by Const-me 2y ago
I ported inference of couple open-source models from Torch/Python/CUDA into D3D11 compute shaders which runs on all 3D GPUs not just on nVidia.
Whisper was the first, but I can’t say I’m happy because too much complicated C++ https://github.com/Const-me/Whisper https://github.com/Const-me/Whisper
For Mistral I decided to rely on C# as much as possible and I like the result much better https://github.com/Const-me/Cgml/ https://github.com/Const-me/Cgml/