3 ms·

Would be cool to know some technical details, like are you fine-tuning GPT-3 on Open AI or built something yourself on top of an open source pretrained model?

JustBreath 4y ago
Anyone care to recommend some open source options? I've read about GPT-J, GPT-NEO, Bloom. Understanding they aren't as effective/intuitive as Open AI's stuff but unlike OpenAI, they are actually open.
- Vasyl_R 4y ago
  That is a good point that you have brought up. We plan to be agnostic of underlying LLMs as ecosystem matures.
Vasyl_R 4y ago
Hey there, you're welcome to our Discord server: https://discord.gg/kMpbueJMtQ https://discord.gg/kMpbueJMtQ - we do share some technical details there and we also share our daily progress in our #updates channel. Have you heard of LangChain ?
- therusskiy 4y ago
  First time I hear about it, but just checked it out - seems pretty cool, but you still need to feed some model into it right? Many examples seem to use OpenAI. I see a bunch of apps using LLMs popping out like mushrooms in a forest, but how do you fine-tune it for your dataset? The biggest (GPT-3 davinci) model on OpenAI is not available for fine-tuning.
  - Vasyl_R 4y ago
    thanks! We tried to do is as simple as possible from the users perspective. You just upload your knowledge base, create a Slack / Discord or other bot and start using it. And sure, we use OpenAI too. Yes, your're right - we use Davince model and then use use LangChain and other approaches that we're exploring to compare performance of different approaches. Have you heard about LangChain?
    - therusskiy 4y ago
      I see a Notion example in Langchain, I assume you guys did something similar. Do you know if there is maximum size of documents that it supports?
      - Vasyl_R 4y ago
        yes, we can say it's something similar) Do you mean the maximum size our app supports? Currently we support files in different formats but with 10Mb size limit.

JustBreath 4y ago

Anyone care to recommend some open source options? I've read about GPT-J, GPT-NEO, Bloom. Understanding they aren't as effective/intuitive as Open AI's stuff but unlike OpenAI, they are actually open.

Vasyl_R 4y ago
That is a good point that you have brought up. We plan to be agnostic of underlying LLMs as ecosystem matures.

Vasyl_R 4y ago

Hey there, you're welcome to our Discord server: https://discord.gg/kMpbueJMtQ https://discord.gg/kMpbueJMtQ - we do share some technical details there and we also share our daily progress in our #updates channel. Have you heard of LangChain ?

therusskiy 4y ago
First time I hear about it, but just checked it out - seems pretty cool, but you still need to feed some model into it right? Many examples seem to use OpenAI. I see a bunch of apps using LLMs popping out like mushrooms in a forest, but how do you fine-tune it for your dataset? The biggest (GPT-3 davinci) model on OpenAI is not available for fine-tuning.
- Vasyl_R 4y ago
  thanks! We tried to do is as simple as possible from the users perspective. You just upload your knowledge base, create a Slack / Discord or other bot and start using it. And sure, we use OpenAI too. Yes, your're right - we use Davince model and then use use LangChain and other approaches that we're exploring to compare performance of different approaches. Have you heard about LangChain?
  - therusskiy 4y ago
    I see a Notion example in Langchain, I assume you guys did something similar. Do you know if there is maximum size of documents that it supports?
    - Vasyl_R 4y ago
      yes, we can say it's something similar) Do you mean the maximum size our app supports? Currently we support files in different formats but with 10Mb size limit.