4 ms·
Meta made Llama 2 source-and-weights available because they agreed with the observations in the leaked Google memo[1]. Meta got a huge amount of infra/research/
by dwrodri 3y ago
Meta made Llama 2 source-and-weights available because they agreed with the observations in the leaked Google memo[1]. Meta got a huge amount of infra/research/experimentation work done on top of LLaMa. Pre-training wasn’t cheap, but they got datapoints no one else in big tech had, abd that is very valuable, especially when building a bridge into a new frontier like LLM-driven products.