4 ms·

If you want to be independent for academic/personal reasons, sure you can. If you want reasoning capabilities that Open Source hasn't matched before today, and

If you want to be independent for academic/personal reasons, sure you can. If you want reasoning capabilities that Open Source hasn't matched before today, and I'm guessing just got blown out of the water on again today... there's no reason to bother.

mg 3y ago
You don't need to use an open source LLM for the approach I described. You can still send the prompts to OpenAI's GPT-4 or any other LLM which is available as a service.
- BoorishBears 3y ago
  What other LLM will compete with GPT-4 Turbo (+ V)? At most you're hedging that Anthropic releases a "Claude 2 Turbo (+ V)": is complicating your setup to such a ridiculous degree vs "zero effort" worth it for that? If things change down the line the fact you invested 5 minutes into writing a prompt isn't going to be such a huge loss anyways, absolutely no reason to roll your own on this.
  - dragonwriter 3y ago
    > If things change down the line the fact you invested 5 minutes into writing a prompt isn't going to be such a huge loss anyways If things change down the road such that your tool (or a major potential downstream market for your tool) is outside of OpenAI's usage policies, the fact that you invested even a few developer-weeks into combining the existing open source tooling to support running your workload either against OpenAI's models or a toolchain consisting of one or more open source models (including a multimodal toolchain tied into image generation models, if that's your thing) with RAG, etc., is going to be a win. If it doesn't, maybe its a wasted-effort loss, but there's lots of other ways it could be a win, too.
    - BoorishBears 3y ago
      Let's go back to my very first comment. > If you want to be independent for academic/personal reasons, sure you can. If your goal is to be in business, or to get some sort of reach, or anything other than "have fun tinkering"... wasting developer weeks on "could be a win" is how to fail.
dragonwriter 3y ago
> If you want to be independent for academic/personal reasons, Or OpenAI's usage policy limits reasons (either because of your direct use, or because of the potential scope of use you want to support for downstream users of your GPT, etc.) Yes, OpenAI's model is the most powerful around. Yes, it would be foolish not to take advantage of it, if you can, in your custom tools that depend on some LLM. Depending on your use, it may not make sense to be fully and exclusively dependent on OpenAI, though.

mg 3y ago

You don't need to use an open source LLM for the approach I described. You can still send the prompts to OpenAI's GPT-4 or any other LLM which is available as a service.

BoorishBears 3y ago
What other LLM will compete with GPT-4 Turbo (+ V)? At most you're hedging that Anthropic releases a "Claude 2 Turbo (+ V)": is complicating your setup to such a ridiculous degree vs "zero effort" worth it for that? If things change down the line the fact you invested 5 minutes into writing a prompt isn't going to be such a huge loss anyways, absolutely no reason to roll your own on this.
- dragonwriter 3y ago
  > If things change down the line the fact you invested 5 minutes into writing a prompt isn't going to be such a huge loss anyways If things change down the road such that your tool (or a major potential downstream market for your tool) is outside of OpenAI's usage policies, the fact that you invested even a few developer-weeks into combining the existing open source tooling to support running your workload either against OpenAI's models or a toolchain consisting of one or more open source models (including a multimodal toolchain tied into image generation models, if that's your thing) with RAG, etc., is going to be a win. If it doesn't, maybe its a wasted-effort loss, but there's lots of other ways it could be a win, too.
  - BoorishBears 3y ago
    Let's go back to my very first comment. > If you want to be independent for academic/personal reasons, sure you can. If your goal is to be in business, or to get some sort of reach, or anything other than "have fun tinkering"... wasting developer weeks on "could be a win" is how to fail.

dragonwriter 3y ago

> If you want to be independent for academic/personal reasons, Or OpenAI's usage policy limits reasons (either because of your direct use, or because of the potential scope of use you want to support for downstream users of your GPT, etc.) Yes, OpenAI's model is the most powerful around. Yes, it would be foolish not to take advantage of it, if you can, in your custom tools that depend on some LLM. Depending on your use, it may not make sense to be fully and exclusively dependent on OpenAI, though.