4 ms·
> $330M is like 33 training runs of a large LLM. Not sure that would bring open source anywhere near GPT-3.5. Open source is already quite near GPT-3.5; it's r
by logicchains 3y ago
> $330M is like 33 training runs of a large LLM. Not sure that would bring open source anywhere near GPT-3.5.
Open source is already quite near GPT-3.5; it's reaching GPT-4 level that is the challenge.