3 ms·
Mac Studio 2022 64 GB RAM M1 Max. Lots of other stuff running. prefill: 1.1620 tokens/sec, decoding: 2.4105 tokens/sec
by TradingPlaces 3y ago
Mac Studio 2022 64 GB RAM M1 Max. Lots of other stuff running.
prefill: 1.1620 tokens/sec, decoding: 2.4105 tokens/sec