3 ms·
I wish someone ran some sort of representative benchmark suite every X days to see if this occurs.
by theLiminator 25d ago
I wish someone ran some sort of representative benchmark suite every X days to see if this occurs.
- micycle1 25d agohttps://marginlab.ai/trackers/codex/ https://marginlab.ai/trackers/codex/
- CamperBob2 25d agoUnfortunately that seems to be monitoring Sol, not Astra, unless I'm missing something.
- embedding-shape 25d agoI'm not sure how you could run such a benchmark without leaving it possible for the labs to easily detect and fudge the results.