3 ms·Given how this works, I don’t think that is possible unless OpenAI implements it themselves.by coder543 3y agoGiven how this works, I don’t think that is possible unless OpenAI implements it themselves.swyx 3y agoreally? the docs seem to promise something like that "can work with any model"coder543 3y agoYes, any model that you can run on your computer. It changes the way that the tokens are sampled from the LLM, and OpenAI does not give you deep enough access into the pipeline to affect that.