2 ms·
540B float32 values in the model. (although since this model was trained via TPUs, likely bfloat16s instead)
by minimaxir 5y ago
540B float32 values in the model. (although since this model was trained via TPUs, likely bfloat16s instead)
- cubefox 5y agoDo those floats encode the weights of synapses? One synapse per float?
- whimsicalism 5y agoThey encode weights. Not sure what a "synapse" is though.
- nynx 5y agoMachine learning models are much more complicated than perceptrons now.