4 ms·
If we have to use an analogy I think a better analogy is that it’s blunt like a dull knife. From a ways back it might look sharp but zoom in and it’s not. The
by whatwhaaaaat 3y ago
If we have to use an analogy I think a better analogy is that it’s blunt like a dull knife. From a ways back it might look sharp but zoom in and it’s not. The only way any of the current ai appears competent in any domain is if the user themselves it not.
- wegfawefgawefg 3y agoI think its totally the other way around actually. It looks blunt from afar, but when you use it on specific fiddly things, it does a great job. Domain experts get the most out of it. The average person really can't use it well. I do agree with you that output on non domain specific tasks does not stand up to scrutiny. However, I often have to remind people that gpt4, and chatgpt in particular are not really llm's functioning at peak performance. gpt3 was amazing before rlhf. i assume the ungimped gpt4 was even better. Its unfortunate because it has damaged the reputation of what would otherwise be superhuman ai, so now everyone thinks ai is just a shitty ghost writer for corporate safe spam. Don't get tricked.
- Hasu 3y ago> Domain experts get the most out of it. The average person really can't use it well. This is the exact opposite of what research has shown so far. Top performers show productivity _decreases_ with LLM assistance, lower performers and less experienced users show a modest improvement. [0] [0] https://www.nber.org/papers/w31161 https://www.nber.org/papers/w31161
- hombre_fatal 3y agoI reckon the midwit meme applies here. Noobs think AI is amazing. Midwits who never bothered to try to leverage it or can't evaluate it or just regurgitate what they hear think it's shit. I wager these people don't create much so they don't have a domain to really apply it, so they rely on others to report how good/bad/useful/shit it is. Then there are creators or tinkerers who've leveraged AI to do obviously time-saving or amazing things understand its power/potential and they have the receipts.
- wegfawefgawefg 3y agoWhat you can do with a tool is mostly a reflection of yourself.
- whatwhaaaaat 3y agoSo what do you find ai so useful in that you are an expert in?
- whatwhaaaaat 3y agoApologies for the double response. I hope you have an example of something that you can, as an expert, validate the consistent accuracy of. It would be useful to hear of others experiences that contradict my own. I’m not saying ai isn’t useful for exploring unfamiliar concepts to get ideas of things that can be researched more deeply but this fits more in the “newb” category you describe.
- whatwhaaaaat 3y agoI figured you would have no response here. Dropping in calling people midwits for not totally fawning over these word generators without even a single example.
- Kye 3y agoLLM output reminds me of the essays I had to write in college. They tick all the boxes in a curriculum and demonstrate a basic grasp on syntax, but they're hot garbage. Your first encounter with an editor as a professional or advanced hobbyist burns that away and reveals the foundation of your true form as a writer. LLMs are in desperate need of something that bridges that gap if they're to do anything more than help people cheat in college and annoy editors. At least for the purpose of producing writing for use. They're great when I want to scrape a web page and its links for archiving and need a quick wget command line.
- ghaff 3y agoAs an often writer, what I find LLMs useful for is creating an editable basis for subtopics/intro/explanatory text for something I'm reasonably familiar with and could write certainly with the help of some Googling around but might take me an hour between various distractions. It doesn't really work to structure an article for me or to create novel explanations/insights from e.g. data. But it does a decent job a lot of the time with respect to various necessary fleshing out.
- wegfawefgawefg 3y agoNo they only write that way because of rlhf. gpt3 was extremely "creative".
- lupire 3y agoYou are oversimplified PP's vague language. That paper shows that AI didn't help people who already had the knowledge that then AI had. High skill Experts (not customer service reps) use AI to extend their knowledge, like using a new API.
- wegfawefgawefg 3y agoCustomer support agents arent really what i meant by... domain expert...