3 ms·
Hey Matthias, I'm curious whether/how you validate copilot output suggestions. Software bugs from generative AI can at least be reasonably tested for by develop
by pseudosudoer 3y ago
Hey Matthias, I'm curious whether/how you validate copilot output suggestions. Software bugs from generative AI can at least be reasonably tested for by developers, but it's certainly much more difficult to catch subtle bugs in hardware.
- rock_hard 3y agoGreat question It’s something we spend a lot of time thinking about. On one side we want to prevent hallucinations but on the other we want to keep the LLMs creativeness We are experimenting with a bunch of different approaches here already Preventing hallucinations and therefore improving correctness is fairly simple by providing the model with factual data sources which is something we are working on The challenge is to balance that so that the model is also still creative when you want it to…but we are making progress here too If you are interested ping us in our slack and we can add you to our beta tester channel to get access to our experiments in this space