4 ms·

Show HN: Mutable.ai Codebase chat that uses a Wiki for RAG

48 points by oshams 2y ago

Hi HN! We wanted to introduce our codebase chat that uses a wiki of your repo to do retrieval instead of traditional vector or keyword RAG. We have been pleasantly surprised by the quality of responses. We think creating a language knowledge base for LLMs to do RAG is the future. The way this works is we first write a Wikipedia style article on your codebase complete with diagrams and citations to your code. We’ve run it on some of the most popular repos. If you want us to run in an open source repo please comment below. You can also run it on private repos and the permissions will follow those of the repository on GitHub. The wikis auto update via a GitHub bot and even show you previews of the new wikis in a diff view. Please check it out and let us know your thoughts. Thank you! Omar PS Here are some examples: https://wiki.mutable.ai/hashicorp/terraform https://wiki.mutable.ai/hashicorp/terraform https://wiki.mutable.ai/ggerganov/llama.cpp https://wiki.mutable.ai/ggerganov/llama.cpp https://wiki.mutable.ai/ethereum/go-ethereum https://wiki.mutable.ai/ethereum/go-ethereum https://wiki.mutable.ai/NVIDIA/TensorRT https://wiki.mutable.ai/NVIDIA/TensorRT https://wiki.mutable.ai/langchain-ai/langchain https://wiki.mutable.ai/langchain-ai/langchain https://wiki.mutable.ai/ollama/ollama https://wiki.mutable.ai/ollama/ollama https://wiki.mutable.ai/tensorflow/models https://wiki.mutable.ai/tensorflow/models https://wiki.mutable.ai/grafana/grafana https://wiki.mutable.ai/grafana/grafana https://wiki.mutable.ai/OpenAutoCoder/Agentless https://wiki.mutable.ai/OpenAutoCoder/Agentless https://wiki.mutable.ai/unslothai/unsloth https://wiki.mutable.ai/unslothai/unsloth https://wiki.mutable.ai/Dao-AILab/flash-attention https://wiki.mutable.ai/Dao-AILab/flash-attention https://wiki.mutable.ai/vercel/next.js https://wiki.mutable.ai/vercel/next.js https://wiki.mutable.ai/microsoft/vscode https://wiki.mutable.ai/microsoft/vscode https://wiki.mutable.ai/wasm3/wasm3 https://wiki.mutable.ai/wasm3/wasm3 https://wiki.mutable.ai/deepfakes/faceswap https://wiki.mutable.ai/deepfakes/faceswap https://wiki.mutable.ai/huggingface/transformers https://wiki.mutable.ai/huggingface/transformers https://wiki.mutable.ai/vllm-project/vllm https://wiki.mutable.ai/vllm-project/vllm

andrewnc 2y ago
Hey this is great! How long does it take to generate the Wiki when setting up, and what have you found is the best way to keep it up to date?
- oshams 2y ago
  it takes a few hours but we're adding parallelization so it takes only a few minutes for typical repos for it to stay up to date simply have an active subscription and we'll take care of the rest!
karolist 2y ago
This is pretty cool, congrats on the launch. Could you run it on Blender? https://github.com/blender/blender https://github.com/blender/blender
- oshams 2y ago
  sure thing, running it now!
codetrotter 2y ago
Looking at the diagrams of one of your provided examples, https://wiki.mutable.ai/deepfakes/faceswap https://wiki.mutable.ai/deepfakes/faceswap I think there is room for improvement I don’t feel that any of those diagrams would really help me if my goal is to dive into that codebase
- oshams 2y ago
  have you tried the chat?
- jdross 2y ago
  i agreed with you but the chat is what shines. gave me SOTA answers to how i should solve a set of tickets and problems i was interested in on my codebase
theogravity 2y ago
Looks neat. Can you generate on some of my repos (since when I tried it says to contact): https://github.com/theogravity/loglayer https://github.com/theogravity/loglayer https://github.com/theogravity/electron-dl-manager https://github.com/theogravity/electron-dl-manager (Really interested in how it works with this one since it's a monorepo) https://github.com/theogravity/datadog-transports https://github.com/theogravity/datadog-transports
- oshams 2y ago
  yep!
  - laurentlb 2y ago
    I wanted to try mutable.ai on my open-source project one month ago. I contacted info@ but I still haven't got any response. The repo is https://github.com/laurentlb/shader-minifier https://github.com/laurentlb/shader-minifier and I'm curious to see how well it works with F#.
    - oshams 2y ago
      generating!
deleted 2y ago
[deleted]
joshka 2y ago
Please don't request email address when authorizing using github auth. This invariably leads to spam, either intentionally, or accidentally when services don't guard their database / email sending. Instead make this optional and if not entered prompt me to provide an email address once signed up (and do the right email confirmation dance as needed).
- oshams 2y ago
  Thanks for the suggestion but we need to alert our users of important changes!
  - joshka 2y ago
    Then ask for an email address for that purpose... in your app... for your app...
p1esk 2y ago
Are you using gpt4?
tannercollin 2y ago
This is really impressive! Would you mind running it on: https://github.com/Protospace/spaceport https://github.com/Protospace/spaceport This is a member portal for my local makerspace. Having a knowledge base will help other makerspace members contribute to the code.
terencezl 2y ago
I like the chat interface. It's more dedicated than the universal archival list of past conversations on Anthropic & ChatGPT. Repo is a good unit of work in a developer's mental model. I tried a few chats and answers have been concise.
johtso 2y ago
Any chance you could run this on the Effect codebase? Definitely an example of a project that can be hard to navigate due to its scope and gaps in documentation https://github.com/Effect-TS/effect https://github.com/Effect-TS/effect
- johtso 2y ago
  Oh I see it's already done! Is it possible to update it to the latest and greatest version? I have to say, the chat responses are quite impressive so far. The linking to relevant sections of code or documentation not so much. I guess that's a pretty hard problem.
  - oshams 2y ago
    yeah on it!

48 points by oshams 2y ago

andrewnc 2y ago

Hey this is great! How long does it take to generate the Wiki when setting up, and what have you found is the best way to keep it up to date?

oshams 2y ago
it takes a few hours but we're adding parallelization so it takes only a few minutes for typical repos for it to stay up to date simply have an active subscription and we'll take care of the rest!

karolist 2y ago

This is pretty cool, congrats on the launch. Could you run it on Blender? https://github.com/blender/blender https://github.com/blender/blender

oshams 2y ago
sure thing, running it now!

codetrotter 2y ago

Looking at the diagrams of one of your provided examples, https://wiki.mutable.ai/deepfakes/faceswap https://wiki.mutable.ai/deepfakes/faceswap I think there is room for improvement I don’t feel that any of those diagrams would really help me if my goal is to dive into that codebase

oshams 2y ago
have you tried the chat?
jdross 2y ago
i agreed with you but the chat is what shines. gave me SOTA answers to how i should solve a set of tickets and problems i was interested in on my codebase

theogravity 2y ago

Looks neat. Can you generate on some of my repos (since when I tried it says to contact): https://github.com/theogravity/loglayer https://github.com/theogravity/loglayer https://github.com/theogravity/electron-dl-manager https://github.com/theogravity/electron-dl-manager (Really interested in how it works with this one since it's a monorepo) https://github.com/theogravity/datadog-transports https://github.com/theogravity/datadog-transports

oshams 2y ago
yep!
- laurentlb 2y ago
  I wanted to try mutable.ai on my open-source project one month ago. I contacted info@ but I still haven't got any response. The repo is https://github.com/laurentlb/shader-minifier https://github.com/laurentlb/shader-minifier and I'm curious to see how well it works with F#.
  - oshams 2y ago
    generating!

deleted 2y ago

[deleted]

joshka 2y ago

Please don't request email address when authorizing using github auth. This invariably leads to spam, either intentionally, or accidentally when services don't guard their database / email sending. Instead make this optional and if not entered prompt me to provide an email address once signed up (and do the right email confirmation dance as needed).

oshams 2y ago
Thanks for the suggestion but we need to alert our users of important changes!
- joshka 2y ago
  Then ask for an email address for that purpose... in your app... for your app...

p1esk 2y ago

Are you using gpt4?

tannercollin 2y ago

This is really impressive! Would you mind running it on: https://github.com/Protospace/spaceport https://github.com/Protospace/spaceport This is a member portal for my local makerspace. Having a knowledge base will help other makerspace members contribute to the code.

terencezl 2y ago

I like the chat interface. It's more dedicated than the universal archival list of past conversations on Anthropic & ChatGPT. Repo is a good unit of work in a developer's mental model. I tried a few chats and answers have been concise.

johtso 2y ago

Any chance you could run this on the Effect codebase? Definitely an example of a project that can be hard to navigate due to its scope and gaps in documentation https://github.com/Effect-TS/effect https://github.com/Effect-TS/effect

johtso 2y ago
Oh I see it's already done! Is it possible to update it to the latest and greatest version? I have to say, the chat responses are quite impressive so far. The linking to relevant sections of code or documentation not so much. I guess that's a pretty hard problem.
- oshams 2y ago
  yeah on it!