44 ms·
And what’s the correct answer in December 2023 if one wants to narrow down only to tools and services provided on Azure?
by yu3zhou4 3y ago
And what’s the correct answer in December 2023 if one wants to narrow down only to tools and services provided on Azure?
- yu3zhou4 3y agoIs Llamaindex + hosted model on Azure OpenAI Services still the best option?
- isoprophlex 3y agoThere's Azure AI studio which is kinda like AWS bedrock. It's not bad, but for max control and versatility i'd start out rolling my own w/ for example llamaindex+azure-branded openai like you say.
- yu3zhou4 3y agoThanks. Is it possible to have persistent RAG in Azure AI Studio though? I found only a preview version of uploading files that are available to model, but when using this model through API, this uploaded data is not available to the model Likely I misunderstood about how RAG works with Azure AI Studio, so sorry in advance
- isoprophlex 3y agohttps://github.com/azure/aistudio-copilot-sample https://github.com/azure/aistudio-copilot-sample Check it out, specifically steps 3 and 4. As with almost every Microsoft CLI tool and SDK, it's clunky... and you can tell everyone is rushing this AI shit out as fast as they can to stay in the game. But what you want should be doable.
- yu3zhou4 3y agoMuch thanks to you
- isoprophlex 3y agoHappy holidays, and good luck building!
- yu3zhou4 3y agoThanks, and same for you
- SgtBastard 3y agohttps://github.com/microsoft/semantic-kernel https://github.com/microsoft/semantic-kernel Semantic Kernel is MS's response to LangChain and LlamaIndex - available for .NET, python and Java. Using their Memory support (using Azure Cognitive Search), it gives a powerful RAG quickstart, which you can combined with Azure Document Intelligence to chunk your source documentation into memories that your foundational models can later use. (Disclaimer: Its only very recently gone 1.0 and is still likely to undergo API change as the LLM domain itself is still rapidly evolving - I've substantially forked the project for my own needs, but I hope that as it stabilises, I can contribute PRs for some of my more advanced use cases).
- yu3zhou4 3y agoThanks for the link and good luck with your contributions to this project