4 ms·
The setup that MS supplies as a one click solution on Azure [1] splits documents by page and stores a vector on the recently renamed to Azure AI Search services
by wodenokoto 3y ago
The setup that MS supplies as a one click solution on Azure [1] splits documents by page and stores a vector on the recently renamed to Azure AI Search services.
From there on they use a special API that comes with Azure Open AI deployed GPT models that will look up using either cognitive search service or vector search.
That API is a black box, so either they use user message or they have the LLM write a search query.
I would assume 365 uses basically the same architecture.
[1] if you do the one click deployment and look through the deployed web app you will see it is based of this GitHub repo: https://github.com/microsoft/sample-app-aoai-chatGPT https://github.com/microsoft/sample-app-aoai-chatGPT