3 ms·
Obviously. That's why I led with that statement. Those are the quant thresholds where people with mid-high end hardware can run this locally at reasonable spee
by Aurornis 9mo ago
Obviously. That's why I led with that statement.
Those are the quant thresholds where people with mid-high end hardware can run this locally at reasonable speed, though.
In my experience Q2 is flakey, but Q4 isn't dramatically worse.
- deleted 9mo ago[deleted]
- cubefox 9mo ago> Obviously. That's why I led with that statement. Then why did you write this? > It's always possible that there are some bugs in early implementations that need to be fixed later, but so far I don't see any reason to believe this is actually a Sonnet 4.5 level model.