I extended my reply before seeing your response, and my response to your reply is largely contained within that. LLMs do not just return a probability distribu

I extended my reply before seeing your response, and my response to your reply is largely contained within that. LLMs do not just return a probability distribution (and their prompts are not questions about probability distributions.) It would be a category error to conflate something that is part of how they work for the totality of what they do. When you say "GPT, for all its clever responses, could be replaced with that hashtable with no loss of fidelity", where does one get all the prompts that will be given to it, in advance? A hash table does not respond to any input for which it has not already been given a response to return.