3 ms·
I think this discussion is silly in the context of a modern LLM. Nobody really understands how an LLM works, and you absolutely do not actually want to retrain
by Wowfunhappy 2y ago
I think this discussion is silly in the context of a modern LLM. Nobody really understands how an LLM works, and you absolutely do not actually want to retrain Llama from scratch.
When I said "it's not really open source", I was referring to the fact that there are restrictions on who can use Llama.
- fragmede 2y agoJust because you don't, don't assume others don't as well. I particular, I liked https://www.anthropic.com/news/golden-gate-claude https://www.anthropic.com/news/golden-gate-claude and https://neuralblog.github.io/llama3-neurons/neuron_viewer.html#24,2362 https://neuralblog.github.io/llama3-neurons/neuron_viewer.ht... and https://github.com/labmlai/inspectus https://github.com/labmlai/inspectus
- _heimdall 2y agoWell that's a much deeper rabbit hole - we shouldn't be using such massive systems or throwing so many resources at them when no one even knows how they work.