3 ms·
That's a good point. Are you referring to the out of date cuda libraries?
by kuczmama 3y ago
That's a good point. Are you referring to the out of date cuda libraries?
- eurekin 3y agoI don't remember exactly (either cuda directly or the cudnn version used by the flashattention)... Anyway, /r/localLlama has few instances of such builds. Might be really worthwhile looking that up before buying