3 ms·

> how exactly would you evaluate how well they show empathy? How would you want yours rated? By someone you have communicated with, or some data centre somewhe

> how exactly would you evaluate how well they show empathy? How would you want yours rated? By someone you have communicated with, or some data centre somewhere?

BeetleB 3mo ago
By a knowledgeable/skilled person who listens to the call. (Which the AI solution provides). I suppose you could do that with the survey as well. It'd be an interesting study to see which is more reliable.
- AlotOfReading 3mo ago
  By a knowledgeable/skilled person who listens to the call. (Which the AI solution provides). Can you point me to the information you evidently have about which models Kaiser is using? All I can find is that they're using innovaccer, which can use any of anthropic, openai, and meta models on AWS or azure. Even their published papers don't seem to specify a particular model or capability level, just "AI". For all we know it's a gpt mini or similarly cost-effective model that has the context awareness of a Labrador hearing the word "walk".
  - BeetleB 3mo ago
    > For all we know We don't know, so let's not pre-judge.
    - gusgus01 3mo ago
      Or we listen to the experts who are frustrated with the system? They see the effects even if they don't know the AI model causing it.
- lostlogin 3mo ago
  > By a knowledgeable/skilled person who listens to the call. (Which the AI solution provides). Are you saying that the AI is the same as a knowledgable/skilled person?
  - BeetleB 3mo ago
    No - read my original comment.
    - lostlogin 3mo ago
      > By a knowledgeable/skilled person who listens to the call. (Which the AI solution provides). Sorry, I parsed this as claiming ‘the AI solution provides a quality of results the same as a human.’ Are you actually saying that the AI solution should provide a human with the calls it identifies as needing a human review?