3 ms·
The demo is live. It’s meant to show how snapshot restore works inside a multi-tenant runtime, not just a prompt playground. You can interact with the deployed
by pveldandi 10mo ago
The demo is live. It’s meant to show how snapshot restore works inside a multi-tenant runtime, not just a prompt playground. You can interact with the deployed models and observe how state is restored and managed across them. The focus is on the runtime behavior rather than a chat UI.
- verdverm 10mo agoPlease read the first sentence of the Show HN guidelines, "show" is more specific in this context. This should be a regular submission type https://news.ycombinator.com/showhn.html https://news.ycombinator.com/showhn.html
- pveldandi 10mo agoFair point. I’ll repost as a regular submission instead of Show HN. The goal was to demonstrate the runtime behavior behind multi-model serving rather than a polished end-user app. Appreciate the clarification.
- pveldandi 10mo agoHappy to engage with you if Hulu have any additional questions. Thanks for all the feedback.that was helpful