3 ms·
What would this look like in practice? A net that outputs weights for a new net to use?
by dpoloncsak 5mo ago
What would this look like in practice? A net that outputs weights for a new net to use?
- xigoi 5mo agoCouldn’t you “uncurry” such a process to have only a single network?
- dpoloncsak 5mo agoProbably? I'm no expert, just a SysAdmin trying to keep up really... but in my head it's would look like a form of MoE that would gen the 'Expert' model on demand instead of having a variety baked in. That's assuming you could even reasonably train a neural net to output viable weights, of course.