3 ms·They just need to figure out KV cache turned into a magic black box after that it'll be fineby chiengineer 9mo agoThey just need to figure out KV cache turned into a magic black box after that it'll be fine