5 ms·
I agree, a lot of the code could be improved. But some of what you mentioned is fairly standard. Like "Gaussian Error Linear Units being GELU, w/b for weights/
by fermenflo 7y ago
I agree, a lot of the code could be improved. But some of what you mentioned is fairly standard. Like "Gaussian Error Linear Units being GELU, w/b for weights/biases, etc...
- jsinai 7y agoNot sure how standard that is ...
- steve_musk 7y agoIt’s very standard ML abbreviations.