3 ms·
The article is based on the author's own use case and understanding of Copilot's marketing. I don't think he used Copilot inappropriately, he just had an uncomm
by nicklecompte 3y ago
The article is based on the author's own use case and understanding of Copilot's marketing. I don't think he used Copilot inappropriately, he just had an uncommon need that the tool badly failed to meet.
I will add that Robichaux is far more diligent and skeptical of Copilot than most people who use it, including Microsoft. MSFT's public Bing demo had a ton of awful mistakes, which is shocking: I assumed MSFT would have faked the demo! The fact that they didn't suggests they have a magical and undeserved belief in OpenAI's technology.
I suspect the demo you watched also had a ton of mistakes that went unnoticed - if Power BI makes a pretty graph with a plausible trendline, how many people are really going to go back and check the underlying code, making sure it's doing the right thing to the right data sources? If it generates draft minutes from a meeting transcript, but screws up 5% of the items, those errors likely won't be noticed in a quick spot-check, and will end up misleading people who didn't attend the meeting. Robichaux's post brings up a ton of issues that affect any use case - the tool just is not reliable.