5 ms·

So just so I understand- this is all based on taking input from the user, injecting it in a template prompt that instructs chatgpt to answer the question based

by mdmglr 4y ago

So just so I understand- this is all based on taking input from the user, injecting it in a template prompt that instructs chatgpt to answer the question based on providing it all the source material? What happened to building your own models to run offline?

Kiro 4y ago
That's like complaining that a musician doesn't build their own piano. Or actually, it's like asking why they don't build their own piano factory. No sole developer has the skills or resources to build something like GPT. Even if it was open source no user would be able to run it locally anyway.
- shzhdbi09gv8ioi 4y ago
  No, you completely miss the point. It's like complaining that a musician cannot practice their instrument without software that requires you to be always-online. > Even if it was open source no user would be able to run it locally anyway. You are just stating this, it does not make it true. Several of us are running GPT-3 workloads locally.
  - jw1224 4y ago
    > Several of us are running GPT-3 workloads locally. Unless you work for OpenAI (and your “local” machine somehow has 1TB+ of VRAM, equivalent to roughly 25 A100s), this cannot possibly be true…
    - bdhcuidbebe 4y ago
      1.7k forks… https://github.com/openai/gpt-3 https://github.com/openai/gpt-3 apart from that, several pre trained corpuses had been around for a while
      - jw1224 4y ago
        That repo just seems to be a bunch of JSON files and sample outputs. Am I missing something?
  - Kiro 4y ago
    Very strange counterpoint that makes no sense unless you're just arguing against cloud software in general, which was clearly not the point the parent made. > Several of us are running GPT-3 workloads locally. Several people out of 8 billion is the same as no-one. The point made was that anyone should be able to run this document assistant on their local machine.
  - Eater_of_food 4y ago
    > Several of us are running GPT-3 workloads locally. Do you mind sharing how? I didn't think the model was available to download and thought it was api only?
- mdmglr 4y ago
  It wasn't a complaint. I'm just trying to understand. When I was in school, in AI/ML classes we needed to build our own models. So now I'm guessing that you use existing models... I'm trying to gauge how behind the times I am.
  - sashu123 4y ago
    In this day and age there is no way a well funded University Lab can build a model that is even a fraction as good as GPT-3. Just look at "Bloom", from BigScience a commendable effort but useless for any real world use case compared to GPT-3. Unfortunately moving forward, if you want to build useful apps that use ML Models, you need to call API's from well funded Industry groups.
shrimpx 4y ago
A trained AI model is a platform that you can build applications on. Pretty sure >90% of the developers in this space will be building applications, not models. Kinda like how the vast majority of mobile developers build mobile apps, not mobile operating systems. True, this particular application is pretty simple, but early applications are.
yieldcrv 4y ago
What happened to inventing wheels?
- mdmglr 4y ago
  Ha! I do love making artisan wheels! :)
  - yieldcrv 4y ago
    I agree on that. I think about it multiple times a day, but primarily I want that model but run client side or my own environment, and ideally without the content filter.

by mdmglr 4y ago

Kiro 4y ago

That's like complaining that a musician doesn't build their own piano. Or actually, it's like asking why they don't build their own piano factory. No sole developer has the skills or resources to build something like GPT. Even if it was open source no user would be able to run it locally anyway.

shzhdbi09gv8ioi 4y ago
No, you completely miss the point. It's like complaining that a musician cannot practice their instrument without software that requires you to be always-online. > Even if it was open source no user would be able to run it locally anyway. You are just stating this, it does not make it true. Several of us are running GPT-3 workloads locally.
- jw1224 4y ago
  > Several of us are running GPT-3 workloads locally. Unless you work for OpenAI (and your “local” machine somehow has 1TB+ of VRAM, equivalent to roughly 25 A100s), this cannot possibly be true…
  - bdhcuidbebe 4y ago
    1.7k forks… https://github.com/openai/gpt-3 https://github.com/openai/gpt-3 apart from that, several pre trained corpuses had been around for a while
    - jw1224 4y ago
      That repo just seems to be a bunch of JSON files and sample outputs. Am I missing something?
- Kiro 4y ago
  Very strange counterpoint that makes no sense unless you're just arguing against cloud software in general, which was clearly not the point the parent made. > Several of us are running GPT-3 workloads locally. Several people out of 8 billion is the same as no-one. The point made was that anyone should be able to run this document assistant on their local machine.
- Eater_of_food 4y ago
  > Several of us are running GPT-3 workloads locally. Do you mind sharing how? I didn't think the model was available to download and thought it was api only?
mdmglr 4y ago
It wasn't a complaint. I'm just trying to understand. When I was in school, in AI/ML classes we needed to build our own models. So now I'm guessing that you use existing models... I'm trying to gauge how behind the times I am.
- sashu123 4y ago
  In this day and age there is no way a well funded University Lab can build a model that is even a fraction as good as GPT-3. Just look at "Bloom", from BigScience a commendable effort but useless for any real world use case compared to GPT-3. Unfortunately moving forward, if you want to build useful apps that use ML Models, you need to call API's from well funded Industry groups.

shrimpx 4y ago

A trained AI model is a platform that you can build applications on. Pretty sure >90% of the developers in this space will be building applications, not models. Kinda like how the vast majority of mobile developers build mobile apps, not mobile operating systems. True, this particular application is pretty simple, but early applications are.

yieldcrv 4y ago

What happened to inventing wheels?

mdmglr 4y ago
Ha! I do love making artisan wheels! :)
- yieldcrv 4y ago
  I agree on that. I think about it multiple times a day, but primarily I want that model but run client side or my own environment, and ideally without the content filter.