4 ms·
Nobody suggested checking in anything you don't understand. On the contrary. So maybe try reading again.
by vidarh 4y ago
Nobody suggested checking in anything you don't understand. On the contrary. So maybe try reading again.
- deleted 4y ago[deleted]
- anon7725 4y agoThe parent said: > I'm at the point where I'm preparing to integrate models all over the place Nobody understands these models right now. We don’t even have the weights. You may draw some artificial distinction between literally checking in the source code of a model into your git repo and making a call to some black box API that hosts it. And you may claim that doing so is no different than making a call to Twilio or whatever, but I think there is a major difference: nobody can make a claim about what an LLM will return or how it will return it, cannot make guarantees about how it will fail, etc. I agree with zer00eyz.
- vidarh 4y agoI said that,and you're missing the point. We don't need to understand the models to be able to evaluate the output manually.
- deleted 4y ago[deleted]
- dahart 4y agoTo be fair, “sufficient checks” and “mostly ok much of the time” does imply something not well understood to me. Maybe you could clarify instead of snapping at people, try writing again, if that’s not what you meant?
- vidarh 4y agoFor starter, "sufficient checks" does mean sufficient and that inherently means I need to fully understabd the risks. You're jumping to conclusions not supported by the comment at all. Also, the comment has two parts: One about writing code, and one about integrating models in workflows. To the latter, the point is that for a whole lot of uses you can trivially ensure the failure modes are safe. E.g. I am integrating gpt with my email. "Mostly ok most of the time" applies to things like e.g. summaries and prioritisation, because worst case I just get to an email a bit later. "Sufficient checks" applies to things like writing proposed replies: There's no way I'd send one without reading it, and it's sufficient for me to read through it before pressing send (and making adjustments as needed). Failures here would matter if I intended to make a product of it, but as a productivity tool for myself it just needs to be close enough. There are a whole lot of possibilities like that. But even for coding related tasks there are a whole lot of low risk tasks,such as e.g. generating HTML or CSS, or provide usage examples, or providing a scaffold for something you know well how to do but which are time consuming. If you're trying to make it do things that'd be time consuming to verify sufficiently well, then that's a bad use. The good uses are those where errors are low impact and easy to catch.
- dahart 4y agoThanks for clarifying, this does make it sound like you want to be more careful than the comment above seemed to imply. > You’re jumping to conclusions not supported by the comment at all. That might be true, but you’re making assumptions that your first comment is clear and being interpreted the way you intended. I think it’s fair to point out that your words may imply things you weren’t considering, that asking people to re-read the same words again might not solve the problem you had. The bigger picture here is that you’re talking about using AI to write code that for whatever reason you couldn’t write yourself in the same amount of time. The very topic here also implicitly suggests you’re starting with code you might not fully understand, which is fine, there’s no reason to get upset because someone else disagreed or read your comment that way.
- vidarh 4y agoThat'd justify asking for clarifications, not making pronouncements not supported by the initial comment.
- dahart 4y agoYou’re repeating your assumption that anyone but you knows exactly what is supported by the comment you wrote that does in fact imply in multiple ways that there’s code involved that you don’t fully understand. Why is it fair to expect people to know exactly what you meant, when words often have fuzzy meanings, and in the face of evidence that multiple people interpreted your comment potentially differently than intended?