2 ms·
Oh it's shorthand for number of layers to offload to the GPU for faster inference :) but yes it's probs not the best abbreviation.
by danielhanchen 1y ago
Oh it's shorthand for number of layers to offload to the GPU for faster inference :) but yes it's probs not the best abbreviation.
- stavros 1y agoIt probably isn't, not gonna lie.