3 ms·
Try quantised models. They perform reasonably well, although you probably want to run some benchmarks if you really want to get it done properly.
by selfhoster11 4y ago
Try quantised models. They perform reasonably well, although you probably want to run some benchmarks if you really want to get it done properly.