3 ms·
This may seem counter-intuitive, but model architecture is not the most significant differentiator in LLMs. Not publishing creates negative externalities around
by chem83 4y ago
This may seem counter-intuitive, but model architecture is not the most significant differentiator in LLMs. Not publishing creates negative externalities around collaboration, recruiting etc. and any research organization worth their salt knows better not do avoid publishing. It's similar to the fallacy that Google should've never open-sourced Kubernetes as it allowed other cloud providers to out-compete them.
- xiphias2 4y agoTo me model architecture sounds the most important. Stable diffusion was possible because diffusion model architecture and then doing it in latent space instead of image space and then upscaling. Of course someone still needed to train it, but they did it when it was theoretically possible.