3 ms·
I've been poking around the medical / ehr LLM space and gently asking people how they're preserving privacy and everyone appears to be just shipping data to clo
by jaggederest 1y ago
I've been poking around the medical / ehr LLM space and gently asking people how they're preserving privacy and everyone appears to be just shipping data to cloud providers based solely on a BAA. Kinda baffling to me, my first step would be to set up local models even if they're not as good, data breaches are expensive.
- 999900000999 1y agoEven Ollama + a 2K gaming computer (Nvidia) gets you most of the way there. Technically you could probably just run it on EC2, but then you’d still need HIPPA compliance
- jackvalentine 1y agoSame, and I've just sent an email up the chain to our exec saying 'hey remember those trials we're running and the promises the vendors have made? Here is why they basically can't be held to that anymore. This is a risk we highlighted at the start'
- tyre 1y ago[flagged]
- jackvalentine 1y agoHow should I be reading your comment?
- tyre 1y agoTelling someone “I told you so” doesn’t move things forward. Suggest what to do next and leave the rest out.
- jackvalentine 1y agoYou know I didn't actually just copy and paste an email in to hacker news right? An off the cuff comment on a forum isn't reflective of people's communication styles in a formal context. I'm quite uninterested in your 'advice' which comes from a place of ignorance regarding my relationship with the project, the company and the people.