2 ms·

> I think OpenAI uses a variant of it in their ChatGPT-3.5-Turbo product. is that a guess or is there a source? im curious to read more

• kir-gadjello 4y ago
  It is a guess informed by some familiarity with the literature and by going over the papers authored by researchers credited in the OpenAI's "GPT-4 contributors" web page. I have an expanded list of foundational research that is likely to serve as basis for gpt4 here in my blog: https://kir-gadjello.github.io/posts/gpt4-some-technical-hypotheses/ https://kir-gadjello.github.io/posts/gpt4-some-technical-hyp... Hope it helps!
  • blueblimp 4y ago
    Interesting resource. I had been wondering whether anyone had tried to compile such a list.
  • swyx 4y ago
    thank you! glad i asked