3 ms·

Thanks for the pointer. Any idea of how clever the wrapper around these things is? For example, would OP’s use case simply get forwarded to the neural network

Thanks for the pointer. Any idea of how clever the wrapper around these things is? For example, would OP’s use case simply get forwarded to the neural network as one single input (string of words) or is there some clever preprocessing going on.

tarvaina 4y ago
The only significant bit of preprocessing by the language model is tokenization. You can see how it works here: https://beta.openai.com/tokenizer https://beta.openai.com/tokenizer