3 ms·
Human therapists are often quite bad as well. It took me around 12 before I found a decent one. Not saying that LLMs are better but they do theoretically have m
by zeroonetwothree 11mo ago
Human therapists are often quite bad as well. It took me around 12 before I found a decent one. Not saying that LLMs are better but they do theoretically have more uniform quality.
- nyeah 11mo agoSure, uniformly zero as far as anyone knows.
- RicardoRei 11mo agoExactly. We don't do claims about humans. But there is room for improvement on current LLMs... For researchers to be able to improve LLMs we first need to know how to evaluate them. We can only improve what we can measure so we studied how to measure them :)
- arisAlexis 10mo agoSo it's a cyclical grading? Like elementary math students grading each other's solutions right? How can this even be valid scientifically
- MengerSponge 10mo agoQuality is variable, but did any of those 12 encourage you to kill yourself? If a therapist found to encourage any of their patients to self-harm would lose their license to practice and would likely face prosecution. The plagiarism machine should face the same level of scrutiny.
- mrguyorama 10mo agoHow many were "therapists" or "Counselor" vs actually credentialed professionals? There's also a lot of credentialed professionals who got their credential decades ago and haven't at all kept up with the significant changes or new data over that time. This is a pretty big problem in all of medical care.