4 ms·
If anyone is curious, a Meta Data Scientist published a great piece about how the facts about what LLMs are actually doing (and therefore able to do) and how it
by tj-teej 2y ago
If anyone is curious, a Meta Data Scientist published a great piece about how the facts about what LLMs are actually doing (and therefore able to do) and how it's papered over by using chat bots. It's a long but very engaging read.
https://medium.com/@colin.fraser/who-are-we-talking-to-when-we-talk-to-these-bots-9a7e673f8525 https://medium.com/@colin.fraser/who-are-we-talking-to-when-...
- rahimnathwani 2y agoThis article is long but doesn't mention key concepts like instruction tuning. I'd suggest the Llama paper as a more worthwhile source.
- grey-area 2y agoIt does talk about openai explicitly instruction tuning the llm to try to constrain the output and the limitations of such approaches.
- rahimnathwani 2y agoctrl+F 'struction' 0 results
- grey-area 2y agoThanks for demonstrating the depth of your reading.
- grey-area 2y agoGreat article which really explores why we fall for llms and think they are doing a lot more thinking than they are.Thanks.
- tivert 2y agoThat article is fantastic.
- non_sequitur 2y agothis is a good article but very outdated - none of the examples he cites are relevant anymore