3 ms·
Now grab the list of labels/explanations for each neuron, and train a small LLM only with data for that neuron. Then you get a dictionary/index of LLMs Could
by nico 3y ago
Now grab the list of labels/explanations for each neuron, and train a small LLM only with data for that neuron.
Then you get a dictionary/index of LLMs
Could this be used to parallelize training?
Or create lighter overall language models?
The above would be like doing a “map”, how would we do a “reduce”?