4 ms·
Years ago, I ran into a similar problem working on a program that was doing named entity recognition to assist humans with data entry. We found that, for our pu
by mumblemumble 5y ago
Years ago, I ran into a similar problem working on a program that was doing named entity recognition to assist humans with data entry. We found that, for our purposes, there seemed to be no (realistic) accuracy threshold beyond which the tool would save clients money, because double-checking the machine-generated output was inherently more work than doing it by hand.
So we pivoted the product to being something you would run on full auto, for situations where you didn't need a high level of quality. I'm not sure if that option is available to programmers, though.
- jpeloquin 5y agoMaybe Copilot could be turned into a context-aware search engine? That is, invoking it would return a list of examples that it thinks do the same thing as what you're trying to do, based on your work-in-progress code.
- visarga 5y agoSeems like humans are more creative when they can get inspiration from language models. https://arxiv.org/abs/2107.04007 https://arxiv.org/abs/2107.04007
- bshanks 5y agoIronic if AIs end up being more useful for creativity than for detail-oriented tasks.
- jessmartin 5y agoI honestly think this is where things are going. Man-machine partnership on creative tasks. Not only is it more amenable to current models, it’s higher leverage and less likely to be completely automated away. I wrote a little about this shift to what I think of as “conversational programming”: https://jessmart.in/articles/copilot https://jessmart.in/articles/copilot
- atatatat 5y agoYou're not going to get it out of a generation of people raised by tablets, needs to come from somewhere.
- stormbrew 5y agoThis would be way more interesting of a product than what copilot actually is.
- saurik 5y agoYeah: I would love this; I actually often try to use GitHub like this, and it sort of works at times, except GitHub's search features frankly suck.
- jtbayly 5y agoI would have thought to pivot to an assistive model in the case you mention, and in cars and in copilot. Have the machine notify you when it thinks you’ve made a mistake.
- mumblemumble 5y agoThe thing we ran into was, in cases where the human and the machine disagreed, it was basically never the human that was wrong.