4 ms·

> Call me when an LLM can ingest a pts medical record from 3 different sources in multiple formats ranging from structured data to free form text stored (I shit

> Call me when an LLM can ingest a pts medical record from 3 different sources in multiple formats ranging from structured data to free form text stored (I shit you not) as TIFF files, extract the actual information, and present it for review prior to a visit LLMs were born to do this. > or even just be able to take verbal orders like it used to be: "get a CBC, CMP, TSH, and CXR" GPT-4 of course knew what that meant, although I didn't. I told it to roleplay a potential follow-up: > "Patient with fatigue, weight loss, mild fever. CBC shows anemia, elevated WBC. CMP reveals elevated liver enzymes. TSH normal. CXR clear. Consider ESR, CRP, ANA, and abdominal ultrasound. Possible infection or autoimmune condition. Referral to a hematologist may be warranted."

dogmatism 3y ago
I know an LLM can do this when given the data in an ingestible form it's the taking of data from disparate sources including literal paper faxes that's the hard part
- Sai_ 3y ago
  You’re being dogmatic about your, what seems to me, objections to LLM skills. Making data ingestible is just laborious and unappetising to an engineer. So hand it over to a data entry operator who’ll do this happily for a wage. I’m not sure why the issue of making data available to an LLM is a failure of the LLM. Btw, OpenAI’s LLM can very well parse images, read handwriting, fix sloppy spellings, and extract objects from unstructured data.
- vidarh 3y ago
  There's no need for paper faxes - fax is a digital format. But of course, if you intentionally and pointlessly output to formats that make input to an LLM more work, it will be hard. Other than that dealing with disparate data formats is something LLMs can already do very well, and that can be improved fairly significantly by putting a "straightjacket" on it (making it use APIs or selecting only tokens that fits a given grammar)

dogmatism 3y ago

I know an LLM can do this when given the data in an ingestible form it's the taking of data from disparate sources including literal paper faxes that's the hard part

Sai_ 3y ago
You’re being dogmatic about your, what seems to me, objections to LLM skills. Making data ingestible is just laborious and unappetising to an engineer. So hand it over to a data entry operator who’ll do this happily for a wage. I’m not sure why the issue of making data available to an LLM is a failure of the LLM. Btw, OpenAI’s LLM can very well parse images, read handwriting, fix sloppy spellings, and extract objects from unstructured data.
vidarh 3y ago
There's no need for paper faxes - fax is a digital format. But of course, if you intentionally and pointlessly output to formats that make input to an LLM more work, it will be hard. Other than that dealing with disparate data formats is something LLMs can already do very well, and that can be improved fairly significantly by putting a "straightjacket" on it (making it use APIs or selecting only tokens that fits a given grammar)