3 ms·
Just announced an deep dive blog post with findings about an evaluation benchmark on software development quality. Here is a thread to the most important findin
by zimmski 2y ago
Just announced an deep dive blog post with findings about an evaluation benchmark on software development quality. Here is a thread to the most important findings https://twitter.com/zimmskal/status/1786012661815124024 https://twitter.com/zimmskal/status/1786012661815124024 Blog post is on https://symflower.com/en/company/blog/2024/dev-quality-eval-v0.4.0-is-llama-3-better-than-gpt-4-for-generating-tests/ https://symflower.com/en/company/blog/2024/dev-quality-eval-...
What i am working next: is actually the next version of that eval. The assessments can be improved in lots of ways and there are much more cases coming.