4 ms·
Testing it now in HugstonOne. Running smooth at 5.8 T/S : Loaded Trinity-Large-Preview-UD-Q4_K_XL-00001-of-00005.gguf. The T/S speed is acceptable, also stable
by trilogic 9mo ago
Testing it now in HugstonOne. Running smooth at 5.8 T/S : Loaded Trinity-Large-Preview-UD-Q4_K_XL-00001-of-00005.gguf.
The T/S speed is acceptable, also stable 60 degrees celcius for the gpu temperature.
Accuracy and precision in math problems. So far so good.
Results: https://www.reddit.com/r/Hugston/comments/1qq9d5i/testing_trinity_large_an_open_400b_sparse_moe/?utm_source=share&utm_medium=web3x&utm_name=web3xcss&utm_term=1&utm_content=share_button https://www.reddit.com/r/Hugston/comments/1qq9d5i/testing_tr...