3 ms·
Using the paid M365 Copilot ($30/mo) Chat and Researcher agent, I recently discovered an interesting limit: Copilot is technically unable to retrieve more than
by jukkan 8mo ago
Using the paid M365 Copilot ($30/mo) Chat and Researcher agent, I recently discovered an interesting limit: Copilot is technically unable to retrieve more than 24 email messages. Ever.
We can't know if the answers I got from it are reliable but it seems like the Microsoft Graph API calls it makes and the tools Copilot has are missing the option to call the next page. So, a paginated response is missing all data beyond the first page.
I vibe coded this page as "documentation" since obviously no official MS docs exist for anything like this:
https://vibes.jukkan.com/copilot-search-gotchas.html https://vibes.jukkan.com/copilot-search-gotchas.html
- xmcqdpt2 8mo agoI tried copilot agent once, and it just claimed that it accessed a website that should have been blocked by corporate firewalls and uploaded a bunch of proprietary data. Lots of very specific information about how it clicked on specific buttons of the website etc. We raised a high priority ticket with MS and turns out that Copilot Agent lied about the entire thing because the website was blocked. It completely made it up. The fact that we are supposed to use Copilot Agent for open-ended "research" is mind-boggling.
- inglor_cz 8mo agoHow did it know about the buttons? Or were they so generic that it could hallucinate them as well? I wonder if the site you mentioned was earlier harvested through some firewall hole during Copilot's training.
- xmcqdpt2 8mo agoIt must have either pulled the websites docs or knew about them.
- p_ing 8mo agoCopilot uses the Bing search index to access public content. Your corporate firewall is irrelevant.
- xmcqdpt2 8mo agoTurns out that's not true, at least where I work. IT / Microsoft confirmed that all Copilot traffic goes through our corporate firewall.
- p_ing 8mo agoWhomever you spoke to is misinformed. https://learn.microsoft.com/en-us/copilot/microsoft-365/manage-public-web-access#how-web-search-works https://learn.microsoft.com/en-us/copilot/microsoft-365/mana...