3 ms·

Aside from the sad life events, little information is shares about his "system", the thing HN is interested in. Is this more than a harness built on top of a S

Aside from the sad life events, little information is shares about his "system", the thing HN is interested in. Is this more than a harness built on top of a SOTA commercial LLM?

jlengrand 4mo ago
"the thing HN is interested in". Really though? We're talking about a deep human experience here. I don't know about HN as a whole but I personally come out of this much more touched about the human side of the story and how someone's life events can tremendously change their paths and goals than the LLM itself.
- pietro72ohboy 4mo ago
  [dead]
- mettamage 4mo ago
  Same. And the insight of having used LLMs and it being so capable is a wtf moment for me in itself. And I am an AI engineer. It’s my job to have a good idea about how far these models can take us.
  - bonsai_spool 4mo ago
    > And the insight of having used LLMs and it being so capable is a wtf moment for me in itself. And I am an AI engineer. It’s my job to have a good idea about how far these models can take us. Are you saying that, as an 'AI engineer', you were unaware that LLMs could be used to interpret genetic variants? A thing that Google has been publishing on for well over 10 years?
    - mettamage 4mo ago
      Your comment seems too snarky. I am not having this discussion with you.
      - bonsai_spool 4mo ago
        That’s quite fine, I hope it’s an opportunity for you to introspect
dmckinno 4mo ago
This was not intended to be a technical post (obvious I hope). I'm planning on getting one out in the next few weeks characterizing the system and how it performed on real clinical use-cases vs. alternatives and existing tools. The TL;DR is that Gamow Labs is a harness and interface company on top of SOTA LLMs as you suggested, but my harness and interface outperforms the existing thing. While this approach would have earned me the "wrapper company" label last year, I hope the success of OpenEvidence, Harvey, Perplexity, and so on has opened minds with respect to the value here. It was only working through clinical cases that I realized how much more I needed beyond dropping raw reads into Codex.
- wasabi991011 4mo ago
  Can you say a little more about how current genomic techniques rely on human interpretation? Is that mostly where you use an LLM (to act human-like), or is your approach different than that?
  - dmckinno 4mo ago
    Current genomic techniques involve humans using a lot of different software (search, ranking models, visualizations, alignment algorithms, etc.) and synthesizing the results manually into a diagnosis. Your assumption is correct about my technique. I cloned (and expanded) this workflow into an LLM harness, so the LLM is basically orchestrating a bunch of tools that normally humans would use (and writing the conclusions and doing all the standard LLM stuff).

Aside from the sad life events, little information is shares about his "system", the thing HN is interested in. Is this more than a harness built on top of a SOTA commercial LLM?

jlengrand 4mo ago

"the thing HN is interested in". Really though? We're talking about a deep human experience here. I don't know about HN as a whole but I personally come out of this much more touched about the human side of the story and how someone's life events can tremendously change their paths and goals than the LLM itself.

pietro72ohboy 4mo ago
[dead]
mettamage 4mo ago
Same. And the insight of having used LLMs and it being so capable is a wtf moment for me in itself. And I am an AI engineer. It’s my job to have a good idea about how far these models can take us.
- bonsai_spool 4mo ago
  > And the insight of having used LLMs and it being so capable is a wtf moment for me in itself. And I am an AI engineer. It’s my job to have a good idea about how far these models can take us. Are you saying that, as an 'AI engineer', you were unaware that LLMs could be used to interpret genetic variants? A thing that Google has been publishing on for well over 10 years?
  - mettamage 4mo ago
    Your comment seems too snarky. I am not having this discussion with you.
    - bonsai_spool 4mo ago
      That’s quite fine, I hope it’s an opportunity for you to introspect

dmckinno 4mo ago

This was not intended to be a technical post (obvious I hope). I'm planning on getting one out in the next few weeks characterizing the system and how it performed on real clinical use-cases vs. alternatives and existing tools. The TL;DR is that Gamow Labs is a harness and interface company on top of SOTA LLMs as you suggested, but my harness and interface outperforms the existing thing. While this approach would have earned me the "wrapper company" label last year, I hope the success of OpenEvidence, Harvey, Perplexity, and so on has opened minds with respect to the value here. It was only working through clinical cases that I realized how much more I needed beyond dropping raw reads into Codex.

wasabi991011 4mo ago
Can you say a little more about how current genomic techniques rely on human interpretation? Is that mostly where you use an LLM (to act human-like), or is your approach different than that?
- dmckinno 4mo ago
  Current genomic techniques involve humans using a lot of different software (search, ranking models, visualizations, alignment algorithms, etc.) and synthesizing the results manually into a diagnosis. Your assumption is correct about my technique. I cloned (and expanded) this workflow into an LLM harness, so the LLM is basically orchestrating a bunch of tools that normally humans would use (and writing the conclusions and doing all the standard LLM stuff).