I’ve begun to grok it as “the amount of ram I have to play in before I have to start sharding work” more literally and correctly, it’s the maximum number of to

I’ve begun to grok it as “the amount of ram I have to play in before I have to start sharding work” more literally and correctly, it’s the maximum number of tokens in the input and output, combined, where a token is 4/3 of a word So we’re shifting from 5K words maximum to 40K (per sibling comment, who pointed out 32K context leaked as well)