5 ms·

How's that gonna work when they need to update their model? Also, how would they compete with companies like FB that have an insane amount of conversational dat

How's that gonna work when they need to update their model? Also, how would they compete with companies like FB that have an insane amount of conversational data, or Google, a company that literally indexes the internet?

gmerc 3y ago
Spend money on licensing deals, lock out the competition. The value of the LLM isn’t up to date data, it’s the concepts of extracts. There’s very limited value in a large amount of crap if chinchilla is to be believed. I don’t think stack overflow is all that valuable once your model has access to github due to their good friends at MS. The money in proprietary AI is on the top end now, open source / edge is destroying monetisation on the lower end. Top end means high quality domain specific data.
- insanitybit 3y ago
  > The value of the LLM isn’t up to date data As a heavy ChatGPT user I disagree. Lack of up to date data is one of the biggest issues I face every day - technology changes fast, libraries change APIs, new tech comes out, etc.
  - gmerc 3y ago
    I’m saying if they feed the source into ChatGPT (from their friends at Github) they have everything they need already.
    - insanitybit 3y ago
      Oh. Hm, yeah, that sounds possible. We'll see. There are a lot of places besides Github where people talk about code.
  - gvkhna 3y ago
    I’m working on this problem (heavy user of chatgpt too). What kinds of libraries do you use it for that are out of date. I could hopefully get you into the beta with it having better responses for those libs. Please email me gaurav@gvkhna.com
    - insanitybit 3y ago
      Rust libraries as well as Hashicorp Nomad (has changed a lot since ChatGPT's last training point). Also QuickWit is totally unknown to ChatGPT.
      - fulmicoton 3y ago
        It has information from 2021. ChatGPT presents Quickwit as follows: As of my last knowledge update in September 2021, Quickwit is an open-source search engine infrastructure that is designed for building and deploying search solutions quickly and efficiently. It focuses on providing fast and scalable full-text search capabilities for applications and websites. Quickwit is built on top of the Rust programming language and leverages technologies like the tantivy search engine library.
brianjking 3y ago
They're actually paying for access to the AP and other sources now.

gmerc 3y ago

Spend money on licensing deals, lock out the competition. The value of the LLM isn’t up to date data, it’s the concepts of extracts. There’s very limited value in a large amount of crap if chinchilla is to be believed. I don’t think stack overflow is all that valuable once your model has access to github due to their good friends at MS. The money in proprietary AI is on the top end now, open source / edge is destroying monetisation on the lower end. Top end means high quality domain specific data.

insanitybit 3y ago
> The value of the LLM isn’t up to date data As a heavy ChatGPT user I disagree. Lack of up to date data is one of the biggest issues I face every day - technology changes fast, libraries change APIs, new tech comes out, etc.
- gmerc 3y ago
  I’m saying if they feed the source into ChatGPT (from their friends at Github) they have everything they need already.
  - insanitybit 3y ago
    Oh. Hm, yeah, that sounds possible. We'll see. There are a lot of places besides Github where people talk about code.
- gvkhna 3y ago
  I’m working on this problem (heavy user of chatgpt too). What kinds of libraries do you use it for that are out of date. I could hopefully get you into the beta with it having better responses for those libs. Please email me gaurav@gvkhna.com
  - insanitybit 3y ago
    Rust libraries as well as Hashicorp Nomad (has changed a lot since ChatGPT's last training point). Also QuickWit is totally unknown to ChatGPT.
    - fulmicoton 3y ago
      It has information from 2021. ChatGPT presents Quickwit as follows: As of my last knowledge update in September 2021, Quickwit is an open-source search engine infrastructure that is designed for building and deploying search solutions quickly and efficiently. It focuses on providing fast and scalable full-text search capabilities for applications and websites. Quickwit is built on top of the Rust programming language and leverages technologies like the tantivy search engine library.

brianjking 3y ago

They're actually paying for access to the AP and other sources now.