louiskw

7 ms·

31.
by louiskw 3y ago
This is correct, GGML the library isn't going anywhere
32.
by louiskw 3y ago
Would be great to support more GPU, Metal is the only graphics we support atm with CPU as a fallback
33.
by louiskw 3y ago
Worth clarifying that GGML the library is very much active. GGML as a file format will be superseded by GGUF.
34.
by louiskw 3y ago
It certainly helps, but one of the goals is to help you understand large badly documented/commented codebases
35.
GPU Embedding with GGML(bloop.ai)
123 points by louiskw 3y ago|33 comments
36.
by louiskw 3y ago
bloop (YC S21) | Rust Engineer | Onsite | London, UK Ever wanted to work on Open Source AI devtools? If so, we should speak! My cofounder Gabe and I started training language models for code search in 2021, and like the rest of the world we
37.
by louiskw 3y ago
bloop (YC S21) | Rust Engineer | Onsite | London, UK Ever wanted to work on Open Source AI devtools? If so, we should speak! My cofounder Gabe and I started training language models for code search in 2021, and like the rest of the world we
38.
by louiskw 3y ago
bloop (YC S21) | Rust AI Engineer | Onsite | London, UK We're a YC + tier-1 VC backed startup, working on an AI chat assistant for software developers that can answer questions about any large codebase. About you: you hack around with
39.
by louiskw 3y ago
bloop (YC S21) | Rust AI Engineer | Onsite | London, UK We're a YC + tier-1 VC backed startup, working on an AI chat assistant for software developers that can answer questions about any large codebase. About you: you hack around with
40.
by louiskw 3y ago
I'm sure the other engineers on the project will have their own opinions here, but for me there's the obviously visible parts to the project (the prompt, tools, ...) and the invisible parts (indexing, tokenising/chunking, par
41.
by louiskw 3y ago
No shame at all, very cool! We wanted to go beyond the chat interface, and we have a complicated history management system that ensures answers are reliable in long threads, which wouldn't work with ChatGPT as it removes messages chron
42.
by louiskw 3y ago
It's one shot at the moment, but this isn't by design and may change, as generating code hasn't been our core focus.
43.
by louiskw 3y ago
GitHub oauth doesn't have a way to limit scope to specific repos, but the token is stored local to your device and the app's logic is that only repos you explicitly select are synced. It's also a condition of many LLM provide
44.
by louiskw 3y ago
1. The agent loop runs in GPT4, so the prebuilt binaries come with access to our own OpenAI key (via our hosted proxy) 2. It works with any git repos, you just have to clone them on your local machine first
45.
by louiskw 3y ago
Even if C# isn't supported for code navigation, you should still be able to ask questions as the LLMs will have seen C#. If you want to try it out today (not using your own API key), you could sync something open source.
46.
by louiskw 3y ago
Very cool. I imagine your approach using files/folders + identifiers would work well for small repos, where everything can fit within an 8k prompt. An early prototype of our agent had something similar but with just files/folders
47.
by louiskw 3y ago
Yes, I know that a decent proportion of the community uses bloop to understand open source repos. It can be especially helpful for repos that lack documentation.
48.
by louiskw 3y ago
Exactly, you can see the prompt in this file [0]. I'm not sure how LangChain arrived at their default agent prompt, but you'll almost certainly want to write your own for performance reasons if you put something into production. [
49.
by louiskw 3y ago
We’re experimenting with this, and the answer is yes and no. GPT4 is the only model that can just about run the agent execution, mainly due to context length and quality. We use our own model for the embedding based code retrieval, and will
50.
by louiskw 3y ago
Can you share a screenshot or if the code is open source the repo and query with louis at bloop dot ai I’ve seen a similar issue with the syntax highlighter and less common languages. Either way will debug and fix.
51.
by louiskw 3y ago
That’s not how funding works, Microsoft can’t read your data.
52.
by louiskw 3y ago
Semantic relationships between backend/frontend or microservices are super interesting. We’re not far off, for example you if you index bloop itself with bloop and ask “What message does the backend send to indicate the frontend should
53.
by louiskw 3y ago
We use OpenAI directly, not Azure
54.
by louiskw 3y ago
Soon, we’re working on open sourcing our GPT proxy. As it’s not possible to self serve sign up to a GPT4 API key we haven’t prioritised
55.
by louiskw 3y ago
Generate as few tokens as possible, GPT4 is running a few times to generate a single answer and latency quickly becomes the biggest UX issue. We abandoned most of the common thinking around chain of thought reasoning, finding it didn’t help
56.
by louiskw 3y ago
Yes, have been meaning to do this! We’ve been super focussed on the app itself often at the expense of the marketing site. Glad to hear you found it helpful, I’m around if you have any issues.
57.
by louiskw 3y ago
I haven’t tried Copilot Chat but I imagine the key difference is the context. bloop’s tuned to answer questions from anywhere in a repo, copilot chat uses the context of what you’re looking at in-IDE.
58.
Show HN: Bloop – Answer questions about your code with an LLM agent(github.com)
118 points by louiskw 3y ago|57 comments
59.
by louiskw 3y ago
A lot of the core arguments of the article around trust and safety sound very relevant to the problem I'm trying to solve [0] which is codebase search. Many orgs have a big enough codebase that they can improve productivity with existi
60.
Write lint rules in natural language, enforce policies your linter can't(lintrule.com)
3 points by louiskw 3y ago|0 comments

More ›