3 ms·
What is the purpose of the Rust WASM parser? Didn't understand that easily from the article. Would love a better explanation.
by caderosche 7mo ago
What is the purpose of the Rust WASM parser? Didn't understand that easily from the article. Would love a better explanation.
- joshuanapoli 7mo agoThey use a bespoke language to define LLM-generated UI components. I think that this is supposed to prevent exfiltration if the LLM is prompt-injected. In any case, the parser compiles chunks streaming from the LLM to build a live UI. The WASM parser restarted from the beginning upon each chunk received. Fixing this algorithm to work more incrementally (while porting from Rust to TypeScript) improved performance a lot.