4 ms·
You should check out nanochat. I would personally appreciate it if someone implemented hardware optimized flash attention for my 3090
by mips_avatar 9mo ago
You should check out nanochat. I would personally appreciate it if someone implemented hardware optimized flash attention for my 3090