3 ms·
Ask HN: What open source LLM and diffusion projects do you rely on?
The a16z grant program is cool!
My favorites from the a16z batch were: TheBloke, vLLM, oobabooga.
My suggestions would be:
ExLlama, MLC LLM, an open source fork of text-generation-inference, AutoGPTQ.
What other projects do you rely on?
- PaulHoule 3y agoSBERT