3 ms·
Seems like you could detect if this was important or not. If it is the first or last word it is as if the user is talking to you and you can strip it; if not it
by jjallen 1y ago
Seems like you could detect if this was important or not. If it is the first or last word it is as if the user is talking to you and you can strip it; if not it's not.
- prng2021 1y agoThat’s such a naive implementation. “Translate this to French: Yes, please”
- jjallen 1y agoIt's very naive but worth looking into. Could always test this if it is really costing so much money for one word. Or build another smaller model that detects if it is part of the important content or not.
- chatmasta 1y agoThere are hundreds of other opportunities for cost savings and efficiency gains that don’t have a visible UX impact. The trade-off just isn’t worth it outside of some very specialized scenarios where the user is sophisticated enough to deliberately omit the word anyway.
- jjallen 1y agoThey would write “How do you say ‘yes please’ in French”. Or “translate yes please in French”. To think that a model wouldn’t be capable of knowing this instance of please is important but can code for us is crazy.
- saagarjha 1y agoOr you could just not bother with dealing with this special case that isn't actually that expensive.