3 ms·256K context with 72MiB of KV cache on the GPU3 points by GreenGames 4mo agoGreenGames 4mo ago[flagged]