2 ms·
> We also found good levels of accuracy: the generated documents were 70% accurate, and the generated code was at 60%. I mean, define 'good'. Yikes.
by rsynnott 2y ago
> We also found good levels of accuracy: the generated documents were 70% accurate, and the generated code was at 60%.
I mean, define 'good'. Yikes.
- pxc 2y ago27% code acceptance, and generated documents that are 70% accurate, are 'good' outcomes in the following sense: > Work at large companies has a tendency to blow up, run far behind schedule, then ultimately limp past the finish line in a maimed state. > One of my friends talks about how, when faced by his first failed project on a team, a management consultant responded to all critical self-reflection with "But you'd say that, overall, this was a success?" in a desperate bid to generate a misleading quote to put into a presentation to the board. https://ludic.mataroa.blog/blog/tossed-salads-and-scrumbled-eggs/ https://ludic.mataroa.blog/blog/tossed-salads-and-scrumbled-...