5 ms·

Hey I'm Silas, I worked on this. Lmk if you have any questions!

hiatus 1y ago
This seems like a really cool project and could be really useful in getting to know a new codebase. How do you ensure that the output in the wiki does not contain hallucinations?
- silasalberti 1y ago
  When working with LLMs you can never exclude hallucinations entirely but we‘ve been carefully tuning the system over time and found it to be pretty high signal! The reason we display the code snippets is to make it easy to double check with the source
  - PeterCorless 1y ago
    Can you "chunkify" output so that you can rate different elements independently? Like "This part of the answer is totally cool" and "Wait. This part right here includes a hallucination." Then allow for feedback to be provided if an issue is spotted.
cuuupid 1y ago
This might be a bit off-topic but is this custom-built documentation or did you use a template? I've been on the hunt for pretty documentation tools but have only come up with Mintlify.
- silasalberti 1y ago
  This is entirely custom built but we‘re also fans of Mintlify. We use them for docs.devin.ai
  - cuuupid 1y ago
    Is it custom all the way down or based on something like starlight? I really like Mintlify but $200 per doc site hurts for internal tools. I can see a lot of merit in custom building though especially with making it easier to dump it into `llms.txt` or exposing a search for AI. Hoping that's where DeepWiki is headed :)
PeterCorless 1y ago
Great work Silas! Can this also be trained on externalized sites, such as human-written docs, our web site, public-facing Google docs, etc?
- silasalberti 1y ago
  Currently it uses only the codebase itself. However we‘ve been thinking about adding other source like docs. Can’t promise any timelines yet
  - PeterCorless 1y ago
    Another idea: allow more "chunkified" approvals, and verbatim feedback: "This part is correct, but this next paragraph? You're hallucinating / misinterpreting. What you really need to say is 'x'." Also, I suggested that feedback also get scored in some way. For instance, what if someone is sending malicious feedback? How do you discourage or de-weight someone downvoting good answers while upvoting wrong answers?
c_s_guy 1y ago
Hi Silas! Are there any plans to allow running DeepWiki against private non-GitHub repos (e.g. GitLab, Azure DevOps, etc) and keep the output private?
angaradanuzaya 1y ago
Hey Silas, currently deepwiki is not working for me. Yesterday it was working great and I found it really helpful, today I only see the loading page with skeletons with every prompt.It's slow and most of the times the results never come in. Previously i could see it's chain of thought now there's just the loading page with skeletons. Just wanted to let you know.

This seems like a really cool project and could be really useful in getting to know a new codebase. How do you ensure that the output in the wiki does not contain hallucinations?

silasalberti 1y ago
When working with LLMs you can never exclude hallucinations entirely but we‘ve been carefully tuning the system over time and found it to be pretty high signal! The reason we display the code snippets is to make it easy to double check with the source
- PeterCorless 1y ago
  Can you "chunkify" output so that you can rate different elements independently? Like "This part of the answer is totally cool" and "Wait. This part right here includes a hallucination." Then allow for feedback to be provided if an issue is spotted.

cuuupid 1y ago

This might be a bit off-topic but is this custom-built documentation or did you use a template? I've been on the hunt for pretty documentation tools but have only come up with Mintlify.

silasalberti 1y ago
This is entirely custom built but we‘re also fans of Mintlify. We use them for docs.devin.ai
- cuuupid 1y ago
  Is it custom all the way down or based on something like starlight? I really like Mintlify but $200 per doc site hurts for internal tools. I can see a lot of merit in custom building though especially with making it easier to dump it into `llms.txt` or exposing a search for AI. Hoping that's where DeepWiki is headed :)

PeterCorless 1y ago

Great work Silas! Can this also be trained on externalized sites, such as human-written docs, our web site, public-facing Google docs, etc?

silasalberti 1y ago
Currently it uses only the codebase itself. However we‘ve been thinking about adding other source like docs. Can’t promise any timelines yet
- PeterCorless 1y ago
  Another idea: allow more "chunkified" approvals, and verbatim feedback: "This part is correct, but this next paragraph? You're hallucinating / misinterpreting. What you really need to say is 'x'." Also, I suggested that feedback also get scored in some way. For instance, what if someone is sending malicious feedback? How do you discourage or de-weight someone downvoting good answers while upvoting wrong answers?

c_s_guy 1y ago

Hi Silas! Are there any plans to allow running DeepWiki against private non-GitHub repos (e.g. GitLab, Azure DevOps, etc) and keep the output private?

angaradanuzaya 1y ago

Hey Silas, currently deepwiki is not working for me. Yesterday it was working great and I found it really helpful, today I only see the loading page with skeletons with every prompt.It's slow and most of the times the results never come in. Previously i could see it's chain of thought now there's just the loading page with skeletons. Just wanted to let you know.