5 ms·
Maybe not exactly what you’re asking, but I started doing talk therapy last year. It’s done virtually and I record the session with OBS. As soon as the recordin
by KMnO4 3y ago
Maybe not exactly what you’re asking, but I started doing talk therapy last year. It’s done virtually and I record the session with OBS. As soon as the recording finishes, the following happens:
- The audio is preprocessed (chunked) and sent to Whisper to generate a transcript
- The transcript is sent to GPT-4 to generate a summary, action items, concepts introduced with additional information
- The next meeting’s date/time is added to my calendar
- A chatbot is created that allows me to chat with each session, including playing the role as the therapist and continuing the conversation (with the entire context of what I actually talked about)
It’s been exceedingly helpful to be able to review all my therapy sessions this way.
- kid64 3y agoI hope you're the patient in this scenario, otherwise this is an egregious HIPAA violation.
- mmahemoff 3y agoMight still be a violation if they're the patient? Unless therapist and their employer's consent is given and ofc dependent on the relevant jurisdictions (IANAL).
- aerhardt 3y agoI don’t know about the legality of it, but as a comical skit it’d be hilarious: a patient gets in deep shit with their doctor for violating patient-doctor confidentiality. Sounds straight out of Curb Your Enthusiasm! Edit: It seems it's straight out of Curb, because it is! https://youtu.be/YH55dFlF_Rg?si=kOLC5rGq5fi8tke2 https://youtu.be/YH55dFlF_Rg?si=kOLC5rGq5fi8tke2
- rhcom2 3y agoI'm sincerely happy you're finding value in this and it's a very impressive workflow. The idea of sending my therapy sessions to OpenAI sounds terrifying though.
- fullautomation 3y agoThis is really interesting, are your comfortable with OpenAI having your personal details in this case?
- psychopomp 3y agoI’d love to replicate your workflow. Any luck with speaker diarization using whisper? I’ve tried WhisperX several but it didn’t work.
- Erazal 3y agoI've created an AI Meeting Bot API to do just that [1]. At the moment it runs on AWS, and we're thinking of open-sourcing so you could also run it locally to maintain 100% privacy of such conversations. You'd get speaker diarization, names on top of the recording [2]. [1] https://aimeetingbot.com https://aimeetingbot.com [2] https://spoke-1.gitbook.io/ai-meeting-bot https://spoke-1.gitbook.io/ai-meeting-bot Happy to get in touch and have you run it
- xyst 3y ago[flagged]
- weikju 3y agoI read this as the OP being the patient, not the doctor. Pretty sure a patient is free to violate this confidentiality
- ethbr1 3y agoParent was probably referring to OpenAI having access to therapy notes, once GP sent them, and no legal responsibility to keep them private.
- serial_dev 3y agoI'm sure OP knows this, thought about the risk, guessed the probabilities, assessed the nature of her therapy sessions, and decided the system she was building is worth the risk of her therapy content being available with an intuitive chat interface. Not every therapy session is embarrassing, incriminating, or particularly interesting to anyone but you.
- mattlondon 3y agoOff topic,but where did that gendering come from in your response? I am generally indifferent to personal pronouns but somehow this came across as particularly jarring as I guess it felt like a projection of misogynistic views of female weakness/need for therapy/emotionalness/etc. They/their might have been more appropriate here.
- serial_dev 3y agoEnglish is not my first language, so I beg for your forgiveness that I didn't use the they/them. In my language, there is no gendered pronouns, so it's hard for me to guess what's the correct way. When I use he/him, people tell me I assume everyone on HN and tech is a male. When I use she/her, you come and label me as misogynistic, too. At one point I just give up. Or you know, you could also assume positive intent and not label someone misogynistic based on a comment where gender was not at all important to the discussion.
- iamcreasy 3y agoDid you discover anything interesting by being able to review all the therapy sessions?
- Erazal 3y agowow - really cool. I'm actually the founder of an AI Meeting Bot company - and we're thinking of open-sourcing so you could run exactly this set-up locally with perfect diarization / recording while also maintaining privacy [1]. I'm currently creating code examples, and just finished the "chat with each session". Would love to know how you implemented it. [1] https://aimeetingbot.com https://aimeetingbot.com
- NicoJuicy 3y agoCurious on the code. ( a friend is a psychiatrist and she noticed difficulty with multiple languages and device translations). This flow could help me improve fluency in her sessions ( eg. she has a hardware translation device (expensive) which has significant issues auto translating ), since it's missing context a lot. Eg. When grieving is incorrectly translated between dutch-polish, it defeats a bit of the purpose of being fluent in your native language. Reducing the error rate would help a lot.