3 ms·
This halfway solution might even be the best of both worlds for Facebook - AI researchers are distracted by the shiny-shiny of gray-market weights, instead of w
by dTal 4y ago
This halfway solution might even be the best of both worlds for Facebook - AI researchers are distracted by the shiny-shiny of gray-market weights, instead of working on truly open models. This might also explain why LLaMA wasn't trained to convergence - they're keeping the converged model for themselves.