3 ms·
It's not like a closed model only available to scientists you can't benchmark yourself. Benchmarking should also be done by a 3rd party otherwise we have a conf
by siva7 4y ago
It's not like a closed model only available to scientists you can't benchmark yourself. Benchmarking should also be done by a 3rd party otherwise we have a conflict of interest.
- amrb 4y agoIf this was a cpu/graphic cards sure lets benchmark it, worst case you getting less frames. Here we'd need to see more about its design and safety, else you may be getting recipes for veggie dishes when what you really wanted was fried chicken.
- brookst 4y agoHow would knowing the architecture or safety mechanisms help you decide if it’s going to give incorrect results more than actual testing would? I’m no LLM expert, but I don’t think you can eyeball the arch and say “that’s going to confuse veggies for fried chicken”.