3 ms·
I don't see any significant speed up. also with defaults according to --help -b, --batch-size N logical maximum batch size (default: 204
by wombat23 14d ago
I don't see any significant speed up. also with defaults according to --help
-b, --batch-size N logical maximum batch size (default: 2048)
-ub, --ubatch-size N physical maximum batch size (default: 512)
I also tried double the default. that also means that they can be left to default settings, apparently.