It's not really a function because it doesn't take the entire input and generate the whole output. It's more of a stream of inputs and a stream of outputs, and

It's not really a function because it doesn't take the entire input and generate the whole output. It's more of a stream of inputs and a stream of outputs, and the outputs go back in as inputs. It's basically an app, with app layers doing different things like transforming words into tokens, and processing them with an attention algorithm, and then feeding it through a relatively simple neural net (compared to previous architectures before GPT).