> The future interaction will AI models will most likely be through an API because the models themselves are becoming too large to fit even on the most extreme

> The future interaction will AI models will most likely be through an API because the models themselves are becoming too large to fit even on the most extreme DIY NAS solutions. And yet I spent last night running GPT-J-6B on my desktop CPU at 2 tokens / sec. People are finally starting to optimize these models, and there's a ton of optimization to go. We'll definitely be running these locally in the next few years. This model especially looks like an ideal candidate for CPU optimization, given the pairity with GPT3, and that it's within spitting distance of the size of models like GPT-J-6B.