4 ms·
> Domain experts get the most out of it. The average person really can't use it well. This is the exact opposite of what research has shown so far. Top perform
by Hasu 3y ago
> Domain experts get the most out of it. The average person really can't use it well.
This is the exact opposite of what research has shown so far. Top performers show productivity _decreases_ with LLM assistance, lower performers and less experienced users show a modest improvement. [0]
[0] https://www.nber.org/papers/w31161 https://www.nber.org/papers/w31161
- hombre_fatal 3y agoI reckon the midwit meme applies here. Noobs think AI is amazing. Midwits who never bothered to try to leverage it or can't evaluate it or just regurgitate what they hear think it's shit. I wager these people don't create much so they don't have a domain to really apply it, so they rely on others to report how good/bad/useful/shit it is. Then there are creators or tinkerers who've leveraged AI to do obviously time-saving or amazing things understand its power/potential and they have the receipts.
- wegfawefgawefg 3y agoWhat you can do with a tool is mostly a reflection of yourself.
- whatwhaaaaat 3y agoSo what do you find ai so useful in that you are an expert in?
- whatwhaaaaat 3y agoApologies for the double response. I hope you have an example of something that you can, as an expert, validate the consistent accuracy of. It would be useful to hear of others experiences that contradict my own. I’m not saying ai isn’t useful for exploring unfamiliar concepts to get ideas of things that can be researched more deeply but this fits more in the “newb” category you describe.
- whatwhaaaaat 3y agoI figured you would have no response here. Dropping in calling people midwits for not totally fawning over these word generators without even a single example.
- Kye 3y agoLLM output reminds me of the essays I had to write in college. They tick all the boxes in a curriculum and demonstrate a basic grasp on syntax, but they're hot garbage. Your first encounter with an editor as a professional or advanced hobbyist burns that away and reveals the foundation of your true form as a writer. LLMs are in desperate need of something that bridges that gap if they're to do anything more than help people cheat in college and annoy editors. At least for the purpose of producing writing for use. They're great when I want to scrape a web page and its links for archiving and need a quick wget command line.
- ghaff 3y agoAs an often writer, what I find LLMs useful for is creating an editable basis for subtopics/intro/explanatory text for something I'm reasonably familiar with and could write certainly with the help of some Googling around but might take me an hour between various distractions. It doesn't really work to structure an article for me or to create novel explanations/insights from e.g. data. But it does a decent job a lot of the time with respect to various necessary fleshing out.
- wegfawefgawefg 3y agoNo they only write that way because of rlhf. gpt3 was extremely "creative".
- lupire 3y agoYou are oversimplified PP's vague language. That paper shows that AI didn't help people who already had the knowledge that then AI had. High skill Experts (not customer service reps) use AI to extend their knowledge, like using a new API.
- wegfawefgawefg 3y agoCustomer support agents arent really what i meant by... domain expert...