2 ms·how much context size?by segmondy 2y agohow much context size?smcleod 2y agoJust 4K. Because deepseek doesn't allow for the use of flash attention it means you can't run quantised qkv