5 ms·GGML Flash Attention support merged into llama.cpp3 points by smcleod 2y agoKelteseth 2y agoLooks like this is based on https://arxiv.org/abs/2205.14135 https://arxiv.org/abs/2205.14135