3 ms·What’s the context size?by dcastm 29d agoWhat’s the context size?seanmcdirmid 29d ago128k, 256k is also possible, but my tok/s drops off and the performance isn’t good.