2 ms·
Looks like this is a wrapper around: https://github.com/mlc-ai/web-llm https://github.com/mlc-ai/web-llm Which has a full web demo: https://chat.webllm.ai/ htt
by maxmcd 1y ago
Looks like this is a wrapper around: https://github.com/mlc-ai/web-llm https://github.com/mlc-ai/web-llm
Which has a full web demo: https://chat.webllm.ai/ https://chat.webllm.ai/
- refulgentis 1y agoI am to see it regardless - projects been very low activity for months. Just last night I was thinking about ripping it out before launch. No observable future. EDIT: Ah, wrapper ~= using it as a dependency, no more
- swores 1y agoIs this correct? It doesn't seem so to me, either from the way it works or from what little of the code I've looked at... But I don't have time to do more than the quick glance I just did at a few of the files of each and need to run, so hopefully someone cleverer than me who won't need as much time as me to answer the question could confirm while I'm afk
- refulgentis 1y agoEntirely correct, c.f. LLM.ts. The bit to Show HN here, is about ~40 lines of code. Simple Typescript MVP of calling the library. (source: maintains an LLM client that works across MLC/llama.cpp/3P providers; author of sibling comment that misunderstood initially)
- swores 1y agoThanks! (Have to admit your sibling comment confused the hell out of me.)