5 ms·

Open-Source GPT-4 Platform for Markdown

nyolfen 4y ago
these gpt wrapper apps as a business model are going the way of the dodo, things are moving way too fast
- stavros 4y ago
  In what way? This seems very useful.
  - deleted 4y ago
    [deleted]
  - waboremo 4y ago
    Plugins are coming, and wrappers are still having to pay openAI and on top of that their own slice of the pie. Since wrappers aren't really cultivating the information themselves, nothing is stopping you from making your own either, the openAI API isn't a big difficult secret. You can even ask openAI to write your own integration for you! You can probably also ask openAI about the nextjs/tailwind starter repo everyone of these wrappers keep relying on too.
    - _pdp_ 4y ago
      100% agree on the wrappers. Though, keep in mind that even if you can write your own it does not mean you can support it or even keep up with the latest trends / features. Hacking something over the weekend is doable but supporting long term will take countless of hours which can be spent elsewhere.
    - celestialcheese 4y ago
      You overestimate the willingness and ability of the average org to implement and support things like this on their own.
      - waboremo 4y ago
        I do not, I recognize that they care far more about costs and don't mind throwing one developer at problems internally than outsourcing it to a middleman of a middleman who is overcharging just for access to an API that isn't theirs. Reminder, it's going to get easier to implement things. It is going to get easier to support things. Neither of these two reasons are going to be the catalysts they used to be for businesses anymore.
  - qingdao99 4y ago
    It's effectively a tiny frontend, doing 0.01% of the work, which is attached to another (highly available) product.
- benatkin 4y ago
  The usual knowledge about evaluating products applies. If you go to the website of markprompt the people who made it already appear to be accomplished entrepreneurs, having worked on something called Motif, which I hadn't heard of but appears to be legit. They also have a nice website and everything I read makes it sound like they know what they're doing. These don't count for much but they count for something. I haven't investigated them much but I think this should be assessed like any other startup product.
- mfester 4y ago
  The way it went is: we built this as part of Motif for the past month, and our users loved it. Many asked for a way to add this feature to their existing sites, so we made a standalone platform that streamlines the process, and open sourced it :)
remoquete 4y ago
This looks very nice — a great improvement over existing search engines for docs. It’d be great if it could also scan restructuredText and Asciidoc docs repos.
- mfester 4y ago
  Yes, this will come, we had to start somewhere. Would love a PR on this, should be straightforward.
- mooreds 4y ago
  I filed an issue a few hours ago. https://github.com/motifland/markprompt/issues/5 https://github.com/motifland/markprompt/issues/5 (for asciidoc)
  - mfester 4y ago
    Thanks!
gabereiser 4y ago
This is the future of self support. Instead of those shitty chat bot state machines that only offer the same FAQ you just searched through, it now can infer all your company documentation to your users (external facing of course) so that they can find exactly what they are looking for. MDN docs would be easily searchable (I mean, they already are really accessible). Your company’s fizzbuzz wizbang-SNAPSHOT-bim.bam.boom.jar docs would actually make sense to humans and your engineers will no longer have to be in customer meetings!
- eli 4y ago
  Wonder how often it hallucinates features you don’t have
  - krmblg 4y ago
    Probably also not any more frequent than your average sales guy (at least those that overpromise _every_ feature to their leads/accounts and casually ask you to whip it up and ofc deploy it on a friday afternoon so the promise they made to the strategically and overall super important client isn’t revealed as utter lies).
    - remoquete 4y ago
      A solution like this might be fantastic for docs testing. If docs are indeed the single source of truth for technical products (alongside code), a GPT powered assistant can help identify gaps.
- mooreds 4y ago
  Needs to do a bit more. It choked on a 400 page doc site I tried (at least with the free tier I have access too). I would really like to see it in action on a docbase I'm familiar with, though. Edit: Just tried again, and it hangs on doc 55 out of 421. Here's the site if anyone else wants to give it a go: https://github.com/fusionauth/fusionauth-site/ https://github.com/fusionauth/fusionauth-site/
  - 4y ago
precompute 4y ago
I've seen this website template on a couple of "AI" frontend websites in the past month.
- technics256 4y ago
  Was just thinking the same. But where is it from? Tailwindui?
  - celestialcheese 4y ago
    Tailwind - https://github.com/motifland/markprompt/blob/main/tailwind.config.js https://github.com/motifland/markprompt/blob/main/tailwind.c...
    - mfester 4y ago
      Handmade, but indeed Tailwind.
    - input_sh 4y ago
      Tailwind: CSS framework. TailwindUI: A collection of templates and components made by the Tailwind team. This is Tailwind, but not TailwindUI.
- nnnnico 4y ago
  I was just going to ask about this, it uses tailwind but must be some kind of known template
- ben_w 4y ago
  That's kind of ironic; I made my current website layout by asking ChatGPT. (But then, my current design isn't too different from the one I've been using for over a decade, and it's gone from fashionable to retro in that time).
  - okdood64 4y ago
    > I made my current website layout by asking ChatGPT. Not a frontend developer, but curious what prompt(s) you used?
thund 4y ago
A lot of similar projects - https://github.com/microsoft/semantic-kernel/tree/main/samples/apps/github-qna-webapp-react https://github.com/microsoft/semantic-kernel/tree/main/sampl... - https://www.producthunt.com/posts/gitterbot-io-conversational-docs https://www.producthunt.com/posts/gitterbot-io-conversationa... - https://github.com/neuml/txtai/blob/master/examples/03_Build_an_Embeddings_index_from_a_data_source.ipynb https://github.com/neuml/txtai/blob/master/examples/03_Build... - https://github.com/openai/openai-cookbook/blob/main/examples/Question_answering_using_embeddings.ipynb https://github.com/openai/openai-cookbook/blob/main/examples...
mewpmewp2 4y ago
How are the embeddings created? How does it scan, index and find the appropriate information to feed to the prompt?
- mfester 4y ago
  Embeddings are created using OpenAI's ada model. They are stored in Supabase with the vector extension, which offers a simple way to compute vector similarities. Then the associated sections are added to the prompt context.
  - mewpmewp2 4y ago
    Supabase looks awesome, thanks for that.
yawnxyz 4y ago
If I have fairly fixed documentation and documents (won't be updated in months), what's the benefit of using a vector database (e.g. pinecone or supabase w/ vectors) rather than just saving the pickle (pkl) file and looking it up every time? Shouldn't using the pickle file be much faster/more efficient?
- fzliu 4y ago
  If you have a small number of fixed documents e.g. <100k or so, then I agree that pickling the vectors or storing them as bytearrays would work better. Once you reach a certain scale, it's helpful to potentially use distributed querying and/or different index types, even if you have a fairly static dataset. You can check out a billion-scale search benchmark we recently did here: https://zilliz.com/resources/milvus-performance-benchmark https://zilliz.com/resources/milvus-performance-benchmark (you'll need to supply your email unfortunately). Here's the framework we used as well: https://github.com/zilliztech/vectordb-benchmark https://github.com/zilliztech/vectordb-benchmark
ChocoluvH 4y ago
Cool webUI. Why is it not on Motif main site? https://motif.land/ https://motif.land/

these gpt wrapper apps as a business model are going the way of the dodo, things are moving way too fast

stavros 4y ago
In what way? This seems very useful.
- deleted 4y ago
  [deleted]
- waboremo 4y ago
  Plugins are coming, and wrappers are still having to pay openAI and on top of that their own slice of the pie. Since wrappers aren't really cultivating the information themselves, nothing is stopping you from making your own either, the openAI API isn't a big difficult secret. You can even ask openAI to write your own integration for you! You can probably also ask openAI about the nextjs/tailwind starter repo everyone of these wrappers keep relying on too.
  - _pdp_ 4y ago
    100% agree on the wrappers. Though, keep in mind that even if you can write your own it does not mean you can support it or even keep up with the latest trends / features. Hacking something over the weekend is doable but supporting long term will take countless of hours which can be spent elsewhere.
  - celestialcheese 4y ago
    You overestimate the willingness and ability of the average org to implement and support things like this on their own.
    - waboremo 4y ago
      I do not, I recognize that they care far more about costs and don't mind throwing one developer at problems internally than outsourcing it to a middleman of a middleman who is overcharging just for access to an API that isn't theirs. Reminder, it's going to get easier to implement things. It is going to get easier to support things. Neither of these two reasons are going to be the catalysts they used to be for businesses anymore.
- qingdao99 4y ago
  It's effectively a tiny frontend, doing 0.01% of the work, which is attached to another (highly available) product.
benatkin 4y ago
The usual knowledge about evaluating products applies. If you go to the website of markprompt the people who made it already appear to be accomplished entrepreneurs, having worked on something called Motif, which I hadn't heard of but appears to be legit. They also have a nice website and everything I read makes it sound like they know what they're doing. These don't count for much but they count for something. I haven't investigated them much but I think this should be assessed like any other startup product.
mfester 4y ago
The way it went is: we built this as part of Motif for the past month, and our users loved it. Many asked for a way to add this feature to their existing sites, so we made a standalone platform that streamlines the process, and open sourced it :)

This looks very nice — a great improvement over existing search engines for docs. It’d be great if it could also scan restructuredText and Asciidoc docs repos.

mfester 4y ago
Yes, this will come, we had to start somewhere. Would love a PR on this, should be straightforward.
mooreds 4y ago
I filed an issue a few hours ago. https://github.com/motifland/markprompt/issues/5 https://github.com/motifland/markprompt/issues/5 (for asciidoc)
- mfester 4y ago
  Thanks!

gabereiser 4y ago

This is the future of self support. Instead of those shitty chat bot state machines that only offer the same FAQ you just searched through, it now can infer all your company documentation to your users (external facing of course) so that they can find exactly what they are looking for. MDN docs would be easily searchable (I mean, they already are really accessible). Your company’s fizzbuzz wizbang-SNAPSHOT-bim.bam.boom.jar docs would actually make sense to humans and your engineers will no longer have to be in customer meetings!

eli 4y ago
Wonder how often it hallucinates features you don’t have
- krmblg 4y ago
  Probably also not any more frequent than your average sales guy (at least those that overpromise _every_ feature to their leads/accounts and casually ask you to whip it up and ofc deploy it on a friday afternoon so the promise they made to the strategically and overall super important client isn’t revealed as utter lies).
  - remoquete 4y ago
    A solution like this might be fantastic for docs testing. If docs are indeed the single source of truth for technical products (alongside code), a GPT powered assistant can help identify gaps.
mooreds 4y ago
Needs to do a bit more. It choked on a 400 page doc site I tried (at least with the free tier I have access too). I would really like to see it in action on a docbase I'm familiar with, though. Edit: Just tried again, and it hangs on doc 55 out of 421. Here's the site if anyone else wants to give it a go: https://github.com/fusionauth/fusionauth-site/ https://github.com/fusionauth/fusionauth-site/
- 4y ago

precompute 4y ago

I've seen this website template on a couple of "AI" frontend websites in the past month.

technics256 4y ago
Was just thinking the same. But where is it from? Tailwindui?
- celestialcheese 4y ago
  Tailwind - https://github.com/motifland/markprompt/blob/main/tailwind.config.js https://github.com/motifland/markprompt/blob/main/tailwind.c...
  - mfester 4y ago
    Handmade, but indeed Tailwind.
  - input_sh 4y ago
    Tailwind: CSS framework. TailwindUI: A collection of templates and components made by the Tailwind team. This is Tailwind, but not TailwindUI.
nnnnico 4y ago
I was just going to ask about this, it uses tailwind but must be some kind of known template
ben_w 4y ago
That's kind of ironic; I made my current website layout by asking ChatGPT. (But then, my current design isn't too different from the one I've been using for over a decade, and it's gone from fashionable to retro in that time).
- okdood64 4y ago
  > I made my current website layout by asking ChatGPT. Not a frontend developer, but curious what prompt(s) you used?

thund 4y ago

A lot of similar projects - https://github.com/microsoft/semantic-kernel/tree/main/samples/apps/github-qna-webapp-react https://github.com/microsoft/semantic-kernel/tree/main/sampl... - https://www.producthunt.com/posts/gitterbot-io-conversational-docs https://www.producthunt.com/posts/gitterbot-io-conversationa... - https://github.com/neuml/txtai/blob/master/examples/03_Build_an_Embeddings_index_from_a_data_source.ipynb https://github.com/neuml/txtai/blob/master/examples/03_Build... - https://github.com/openai/openai-cookbook/blob/main/examples/Question_answering_using_embeddings.ipynb https://github.com/openai/openai-cookbook/blob/main/examples...

mewpmewp2 4y ago

How are the embeddings created? How does it scan, index and find the appropriate information to feed to the prompt?

mfester 4y ago
Embeddings are created using OpenAI's ada model. They are stored in Supabase with the vector extension, which offers a simple way to compute vector similarities. Then the associated sections are added to the prompt context.
- mewpmewp2 4y ago
  Supabase looks awesome, thanks for that.

yawnxyz 4y ago

If I have fairly fixed documentation and documents (won't be updated in months), what's the benefit of using a vector database (e.g. pinecone or supabase w/ vectors) rather than just saving the pickle (pkl) file and looking it up every time? Shouldn't using the pickle file be much faster/more efficient?

fzliu 4y ago
If you have a small number of fixed documents e.g. <100k or so, then I agree that pickling the vectors or storing them as bytearrays would work better. Once you reach a certain scale, it's helpful to potentially use distributed querying and/or different index types, even if you have a fairly static dataset. You can check out a billion-scale search benchmark we recently did here: https://zilliz.com/resources/milvus-performance-benchmark https://zilliz.com/resources/milvus-performance-benchmark (you'll need to supply your email unfortunately). Here's the framework we used as well: https://github.com/zilliztech/vectordb-benchmark https://github.com/zilliztech/vectordb-benchmark

ChocoluvH 4y ago

Cool webUI. Why is it not on Motif main site? https://motif.land/ https://motif.land/