4 ms·
> But no one really show how they're actually solving problems with LLMs and how the alternatives were worse for them. It's all claims that it's great with no f
by pbrowne011 2y ago
> But no one really show how they're actually solving problems with LLMs and how the alternatives were worse for them. It's all claims that it's great with no further elaboration on the workflows.
To give an example, one person (a researcher at DeepMind) recently wrote about specific instances of his uses of LLMs, with anecdotes about alternatives to each example. [1] People on HN had different responses with similar claims with elaborations on how it has changed some of their workflows. [2]
While it would be interesting to see randomized controlled trials on LLM usage, hearing people's anecdotes brings to mind the (often misquoted) phrase: "The plural of anecdote is data". [3] [4]
[1] https://nicholas.carlini.com/writing/2024/how-i-use-ai.html https://nicholas.carlini.com/writing/2024/how-i-use-ai.html
[2] https://news.ycombinator.com/item?id=41150317 https://news.ycombinator.com/item?id=41150317
[3] http://blog.danwin.com/don-t-forget-the-plural-of-anecdote-is-data/ http://blog.danwin.com/don-t-forget-the-plural-of-anecdote-i...
[4] originally misquoted as "Anecdote is the plural of data."
- kristianp 2y ago> (often misquoted) phrase You misquoted it there! It should be: The plural of anecdote is data.
- stavros 2y agoIt's actually "the plural of 'anecdote' is not 'data'".
- pbrowne011 2y agoThank you! Another instance of a variant of Muphry's Law. https://en.wikipedia.org/wiki/Muphry's_law https://en.wikipedia.org/wiki/Muphry's_law
- kristianp 2y agoIn the CUDA example [1] from carlini's "how I Use AI", I would guess that o1 would need less handholding to do what he wanted. [1] https://chatgpt.com/share/1ead532d-3bd5-47c2-897c-2d77a3896427 https://chatgpt.com/share/1ead532d-3bd5-47c2-897c-2d77a38964...