My mental model for LLMs was built by carefully studying the distribution of its output vocabulary at every time step. There are tools that allow you to right

My mental model for LLMs was built by carefully studying the distribution of its output vocabulary at every time step. There are tools that allow you to right click and see all possible continuations for an LLM like you would in a code IDE[1]. Seeing what this vocabulary is[2] and how trivial modifications to the prompt can impact probabilities will do a lot for improving the mental model of how LLM operate. Shameless self plug, but software which can do what I am describing is here, and it's worth noting that it ended up as peer reviewed research. [1] https://github.com/Hellisotherpeople/Constrained-Text-Generation-Studio/tree/main https://github.com/Hellisotherpeople/Constrained-Text-Genera... [2] https://github.com/Hellisotherpeople/Constrained-Text-Generation-Studio/blob/main/pictures/list_of_vocab_that_fulfills_constraints.JPG https://github.com/Hellisotherpeople/Constrained-Text-Genera...