2 ms·
Here you go: https://q.uiver.app/#q=WzAsOSxbMCwxLCJcXHRleHR7cXVlcnkgffCfpJYiXSxbMSwxLCLwn6SWXFx0ZXh0ey0gcm91dGVyL21hcHBlciBOTn0iXSxbMiwwLCJcXHRleHR7YGBleHBlcnRc
by measurablefunc 10mo ago
Here you go: https://q.uiver.app/#q=WzAsOSxbMCwxLCJcXHRleHR7cXVlcnkgffCfpJYiXSxbMSwxLCLwn6SWXFx0ZXh0ey0gcm91dGVyL21hcHBlciBOTn0iXSxbMiwwLCJcXHRleHR7YGBleHBlcnRcIiB98J+kll8xIl0sWzIsMiwiXFx0ZXh0e2BgZXhwZXJ0XCIgffCfpJZfbiJdLFsyLDEsIlxcdmRvdHMiXSxbMywxLCLwn6SWXFx0ZXh0ey0gcmVkdWNlci9zZWxlY3RvciBOTn0iXSxbNCwxLCJcXHRleHR7cmVzcG9uc2UgffCfpJYiXSxbMiwzLCJcXHRleHR7QVBJIFNlcnZpY2V9Il0sWzIsNSwi8J+nkeKAjfCfkrsiXSxbMCwxXSxbMSwyXSxbMSwzXSxbMSw0XSxbMiw1XSxbNCw1XSxbMyw1XSxbNSw2XSxbOCw3LCIiLDEseyJvZmZzZXQiOi0zfV0sWzcsMF0sWzYsN10sWzcsOCwiIiwxLHsib2Zmc2V0IjotM31dXQ== https://q.uiver.app/#q=WzAsOSxbMCwxLCJcXHRleHR7cXVlcnkgffCfp...
- tacitusarc 10mo agoOK that’s what I figured you meant. FWIW, MoE as a term of art means something different, what I described. It’s internal to a single model, part of the logit generation process.
- measurablefunc 10mo agoThat's fine, you can pretend my entire diagram is one NN, end result will still be the same whether you put it all inside one box or break it out into many.