3 ms·
if you think of the depth of a model increasing with parameter count, then the number of steps of parallel operations to percolate data through a model would in
by jjtheblunt 2mo ago
if you think of the depth of a model increasing with parameter count, then the number of steps of parallel operations to percolate data through a model would increase with parameter count, which would be inversely related to rate of computing tokens as a result of flowing data through the model.