4 ms·
And Vicuna-33B is not far behind - which you can actually run on a 24GB 3090/4090 GPU unlike LLaMAv2-70B. Although for a lot of tasks, Guanaco outperforms Vicun
by 0xbadc0de5 3y ago
And Vicuna-33B is not far behind - which you can actually run on a 24GB 3090/4090 GPU unlike LLaMAv2-70B. Although for a lot of tasks, Guanaco outperforms Vicuna.