3 ms·
I am hoping that this type of research leads into ways to create highly tuned and steerable models that are also much smaller and more efficient. Because if yo
by ilaksh 3y ago
I am hoping that this type of research leads into ways to create highly tuned and steerable models that are also much smaller and more efficient.
Because if you can see what each part is doing, then theoretically you can find ways to create just the set of features you want. Or maybe tune features that have redundant capacity or something.
Maybe by studying the features they will get to the point where the knowledge can be distilled into something more like a very rich and finely defined knowledge graph.
- quickthrower2 3y agoAnthropic must be walking on multi-dimensional tightropes. They want AI safety, and probably want to avoid every Tom, Dick and Harry having a powerful model. But research output picked up by Meta and various discord group could turn the wooly LLMs into powerful contenders and then you have access to the power for all. I don’t have a strong opinion on what is better, but I lean slightly towards models in the open. After all us plebs are allow to use computers and latest CPUs and internet and stuff already! Yes there is shit happening like scams, and worse but it is better than limiting what people can do.