3 ms·
Off the top of my head - try to implement techniques that are doable on home hardware like the one described in OP (requires some $$$ investment) and give feed
by ativzzz 3y ago
Off the top of my head
- try to implement techniques that are doable on home hardware like the one described in OP (requires some $$$ investment) and give feedback or contribute to documentation / guides
- learn about different techniques and do educational writeups or documentation (like https://vickiboykis.com/2024/02/28/gguf-the-long-way-around/ https://vickiboykis.com/2024/02/28/gguf-the-long-way-around/)
- build a tool / library that wrap academic techinques and expose them more easily to end users (like A1111 or comfyUI for stable diffusion)
Anything that can translate the high end research down to something a moderately technical user can use or learn from is a gigantic win