2 ms·

That's brilliant, I would love to spare compute cycles and network on my devices for this if there's an open source LLM on the other side that I can use in my o

• davely 4y ago
  On the generative image side of the equation, you can do the same thing with Stable Diffusion[1], thanks to a handy open source distributed computing project called Stable Horde[2]. LAION has started using Stable Horde for aesthetics training to back feed into and improve their datasets for future models[3]. I think one can foresee the same thing eventually happening with LLMs. Full disclosure: I made ArtBot, which is referenced in both the PC World article and the LAION blog post. [1] https://www.pcworld.com/article/1431633/meet-stable-horde-the-setihome-of-ai-art.html https://www.pcworld.com/article/1431633/meet-stable-horde-th... [2] https://stablehorde.net/ https://stablehorde.net/ [3] https://laion.ai/blog/laion-stable-horde/ https://laion.ai/blog/laion-stable-horde/
• vineyardmike 4y ago
  > Doesn't feel like there's much competition for ChatGPT at this point otherwise, which can't be good. Facebook open sourced their LLM, called OPT [1]. There's not much else, and OPT isn't exactly easy to run (requires like 8 GPUs). I'm not an expect, so I don't know why some models, like the graphics generation we've seen, are able to fit on phones, while LLM require $500k worth of GPUs to run. Hopefully this is the first step to changing that. [1] https://ai.facebook.com/blog/democratizing-access-to-large-scale-language-models-with-opt-175b/ https://ai.facebook.com/blog/democratizing-access-to-large-s...