3 ms·
Where do these analogies break down? 1. Similar cost structure to electricity, but non-essential utility (currently)? 2. Like an operating system, but with no
by nilirl 1y ago
Where do these analogies break down?
1. Similar cost structure to electricity, but non-essential utility (currently)?
2. Like an operating system, but with non-determinism?
3. Like programming, but ...?
Where does the programming analogy break down?
- deleted 1y ago[deleted]
- rudedogg 1y ago> programming The programming analogy is convenient but off. The joke has always been “the computer only does exactly what you tell it to do!” regarding logic bugs. Prompts and LLMs most certainly do not work like that. I loved the parallels with modern LLMs and time sharing he presented though.
- diggan 1y ago> Prompts and LLMs most certainly do not work like that. It quite literally works like that. The computer is now OS + user-land + LLM runner + ML architecture + weights + system prompt + user prompt. Taken together, and since you're adding in probabilities (by using ML/LLMs), you're quite literally getting "the computer only does exactly what you tell it to do!", it's just that we have added "but make slight variations to what tokens you select next" (temperature>0.0) sometimes, but it's still the same thing. Just like when you tell the computer to create encrypted content by using some seed. You're getting exactly what you asked for.
- politelemon 1y agoonly in English, and also non-deterministic.
- malux85 1y agoYeah, wherever possible I try to have the llm answer me in Python rather than English (especially when explaining new concepts) English is soooooo ambiguous
- falcor84 1y agoFor what it's worth, I've been using it to help me learn math, and I added to my rules an instruction that it should always give me an example in Python (preferably sympy) whenever possible.
- PeterStuer 1y agoDefine non-essenti The way I see dependency in office ("knowledge") work: - pre-(computing) history. We are at the office, we work - dawn of the pc: my computer is down, work halts - dawn of the lan: the network is down, work halts - dawn of the Internet: the Internet connection is down, work halts (<- we are basically all here) - dawn of the LLM: ChatGPT is down, work halts (<- for many, we are here already)
- nilirl 1y agoI see your point. It's nearing essential.