2 ms·
thanks! Streaming was actually pretty hard to get working, but it goes roughly like this as a streaming pipeline: - The LLM is prompted to generate an explaine
by zan2434 2y ago
thanks! Streaming was actually pretty hard to get working, but it goes roughly like this as a streaming pipeline:
- The LLM is prompted to generate an explainer video as sequence of small Manim scene segments with corresponding voiceovers
- LLM streams response token-by-token as Server-Sent-Events
- Whenever a complete Manim segment is finished, send it to Modal to start rendering
- Start streaming the rendered partial video files from manim as they are generated via HLS