4 ms·
According to nvidia https://blogs.nvidia.com/blog/mistral-nvidia-ai-model/ https://blogs.nvidia.com/blog/mistral-nvidia-ai-model/ it was made to fit on a 4090 s
by renewiltord 2y ago
According to nvidia https://blogs.nvidia.com/blog/mistral-nvidia-ai-model/ https://blogs.nvidia.com/blog/mistral-nvidia-ai-model/ it was made to fit on a 4090 so it should work with 24 GB.