ChatGPT and GPT are APIs over LLMs. The huge vector is what the neural net outputs. ‘Sampling’ is the process whereby a token is selected. The API wraps up th

ChatGPT and GPT are APIs over LLMs. The huge vector is what the neural net outputs. ‘Sampling’ is the process whereby a token is selected. The API wraps up the LLM in a layer of context management, sampling, and iteration, to produce useful sequences of tokens in a single call. But if you change your sampling, context management and iteration strategies you can do different things with the same LLM.