4 ms·

Do you have an IDE integration? What I find so great about Copilot/GPT-4 is how it's integrated into VSCode/Jetbrains and can use the context you're in. Like kn

Do you have an IDE integration? What I find so great about Copilot/GPT-4 is how it's integrated into VSCode/Jetbrains and can use the context you're in. Like knowing what line you highlighted, what documents you have open, etc. Do you copy paste into whatever chatbot you're using?

varjag 3y ago
I'm sure one can just ask Claude to code the integration, it has to be so good.
AndyNemmity 3y ago
Do you have any tips? I find copilot so much worse when trying to use it in VCCode, even with the integration. It just seems to do a much worse job than pasting your code into the chat UI. Like, it's answers are just profoundly bad in comparison.
- bilekas 3y ago
  Using copilot in both vsc and vs2022 . I see vast differences but usually down to the language I'm working with. I've noticed that in visual studio (IDE) copilot gives better answers if I physically view an interface or implementation, then I get "okay" results. But it stuggles with larger more abstract projects. Vscode is better for sure, but usually I'm working in smaller projects or interpreted languages. The vim copilot extension is probably the better bit again I'm not working with dotnet in vim.
paradite 3y ago
I had the same problem of copying and pasting code into LLM web UI so I built a small tool to streamline the process and add source code into the prompt: https://prompt.16x.engineer/ https://prompt.16x.engineer/ You can't rely on IDE auto context since the entire codebase is too large to feed into LLM (maybe Claude 3 200k context token can take it, but too expensive). And RAG is not smart enough to figure which part of code is relevant.
- barbazoo 3y ago
  > You can't rely on IDE auto context since the entire codebase is too large to feed into LLM It's not feeding in the entire codebase but whatever you selected or whatever files you have open, at least that's what the UI suggests. So I ask it "what does this line do" and I get an answer that uses the whole file to explain what the line does.
  - theturtletalks 3y ago
    That works, but for more complex questions taking into account different files and the whole architecture of the app, CoPilot fails. I've been trying to RAG my repos to accomplish this, but the parent comment said that's not possible.
    - paradite 3y ago
      I believe https://aider.chat/ https://aider.chat/ is working on RAG for codebase.
  - paradite 3y ago
    Yeah for context within the single file, GitHub Copilot is good, I use it all the time. But if you use it to do something across multiple files (DB schema, service, controller, HTML, JavaScript), then it becomes less accurate (precision vs recall problem) as like you said it uses your open windows or some heuristics to decide what's the context. With an IDE as an interface, it is just not intuitive, UX wise, to "open tabs" to signal to GitHub Copilot that the files should be included in the context.
toth 3y ago
Is github copilot using GPT-4 or 3.5? I've tried to find out for sure but I can't seem to find the information anywhere
- paradite 3y ago
  GitHub Copilot uses OpenAI Codex, which is a much older model fined-tuned on GPT-3. Definitely not GPT-4, otherwise it would not be less than $10 a month for constant usage.
  - csnweb 3y ago
    The chat part (mostly) uses GPT-4, you can also see which model is called in the request logs. Here is the official announcement: https://github.blog/changelog/2023-11-30-github-copilot-november-30th-update/ https://github.blog/changelog/2023-11-30-github-copilot-nove...
    - paradite 3y ago
      Okay thanks for pointing that out. I figure if they do this, they have to throttle or nert it somehow since it is cheaper than ChatGPT Plus which also gives access to GPT-4.
      - csnweb 3y ago
        It won’t answer questions that are not somehow related to code or computing, I usually don’t need anything else so I didn’t really test the limits of that so far.
- mellosouls 3y ago
  I think 3.5, that was the last official note. Copilot Chat uses 4, but it's suspiciously free of confirmation that is also used in the more contextual Copilot (no-chat).
mellosouls 3y ago
You have contextual IDE integration with the main LLMs including OpenAI and Claude within Cursor (a VSCode "AI first" derivative), though I haven't tried it but heard good things.

varjag 3y ago

I'm sure one can just ask Claude to code the integration, it has to be so good.

AndyNemmity 3y ago

Do you have any tips? I find copilot so much worse when trying to use it in VCCode, even with the integration. It just seems to do a much worse job than pasting your code into the chat UI. Like, it's answers are just profoundly bad in comparison.

bilekas 3y ago
Using copilot in both vsc and vs2022 . I see vast differences but usually down to the language I'm working with. I've noticed that in visual studio (IDE) copilot gives better answers if I physically view an interface or implementation, then I get "okay" results. But it stuggles with larger more abstract projects. Vscode is better for sure, but usually I'm working in smaller projects or interpreted languages. The vim copilot extension is probably the better bit again I'm not working with dotnet in vim.

paradite 3y ago

I had the same problem of copying and pasting code into LLM web UI so I built a small tool to streamline the process and add source code into the prompt: https://prompt.16x.engineer/ https://prompt.16x.engineer/ You can't rely on IDE auto context since the entire codebase is too large to feed into LLM (maybe Claude 3 200k context token can take it, but too expensive). And RAG is not smart enough to figure which part of code is relevant.

barbazoo 3y ago
> You can't rely on IDE auto context since the entire codebase is too large to feed into LLM It's not feeding in the entire codebase but whatever you selected or whatever files you have open, at least that's what the UI suggests. So I ask it "what does this line do" and I get an answer that uses the whole file to explain what the line does.
- theturtletalks 3y ago
  That works, but for more complex questions taking into account different files and the whole architecture of the app, CoPilot fails. I've been trying to RAG my repos to accomplish this, but the parent comment said that's not possible.
  - paradite 3y ago
    I believe https://aider.chat/ https://aider.chat/ is working on RAG for codebase.
- paradite 3y ago
  Yeah for context within the single file, GitHub Copilot is good, I use it all the time. But if you use it to do something across multiple files (DB schema, service, controller, HTML, JavaScript), then it becomes less accurate (precision vs recall problem) as like you said it uses your open windows or some heuristics to decide what's the context. With an IDE as an interface, it is just not intuitive, UX wise, to "open tabs" to signal to GitHub Copilot that the files should be included in the context.

toth 3y ago

Is github copilot using GPT-4 or 3.5? I've tried to find out for sure but I can't seem to find the information anywhere

paradite 3y ago
GitHub Copilot uses OpenAI Codex, which is a much older model fined-tuned on GPT-3. Definitely not GPT-4, otherwise it would not be less than $10 a month for constant usage.
- csnweb 3y ago
  The chat part (mostly) uses GPT-4, you can also see which model is called in the request logs. Here is the official announcement: https://github.blog/changelog/2023-11-30-github-copilot-november-30th-update/ https://github.blog/changelog/2023-11-30-github-copilot-nove...
  - paradite 3y ago
    Okay thanks for pointing that out. I figure if they do this, they have to throttle or nert it somehow since it is cheaper than ChatGPT Plus which also gives access to GPT-4.
    - csnweb 3y ago
      It won’t answer questions that are not somehow related to code or computing, I usually don’t need anything else so I didn’t really test the limits of that so far.
mellosouls 3y ago
I think 3.5, that was the last official note. Copilot Chat uses 4, but it's suspiciously free of confirmation that is also used in the more contextual Copilot (no-chat).

mellosouls 3y ago

You have contextual IDE integration with the main LLMs including OpenAI and Claude within Cursor (a VSCode "AI first" derivative), though I haven't tried it but heard good things.