3 ms·
I wouldn't trust any output from Astra unless they have not nerfed instances ringfenced for that task. Tried again a simple coding task with Astra maxed out. I
by varispeed 8d ago
I wouldn't trust any output from Astra unless they have not nerfed instances ringfenced for that task.
Tried again a simple coding task with Astra maxed out. I did it only partially, left memory leak and hanging pointer. Sol spotted are errors immediately. I put findings of Sol to Astra and it only done partial fix with the rest claiming will remain unresolved. Sol fixed it in a minute.
I then tried Astra on farily long legal document to produce an excerpt. The excerpt had wrong conclusion and logical errors. When pointed out that the source text has the claims other way round, Astra agreed and then when asked to produce the excerpt again, it again made the same errors.
Absolutely awful model.