5 ms·
FYI one of the models on the battle was pretty slow to load. Are these also being rated on latency or just quality?
by fzysingularity 11mo ago
FYI one of the models on the battle was pretty slow to load. Are these also being rated on latency or just quality?
- andrewlu0 11mo agoideally we want people to rate based on quality - but i imagine some of the results are biased rn based on loading time
- hdjrudni 11mo agoThat's an easy fix if you wait for the slowest one and pop them both in at the same time, no?
- kbyatnal 11mo agoUltimately, there’s some intersection of accuracy x cost x speed that’s ideal, which can be different per use case. We’ll surface all of those metrics shortly so that you can pick the best model for the job along those axes.