3 ms·

Is this the same backend that is powering https://denigma.app https://denigma.app ?

mdaniel 5y ago
Almost certainly not --- That was also the first time I had heard of denigma.app and their tagline of We stress-tested it on the worst, most obscure code we could find. That's why we're confident it will work on your complex codebase. gave me a good chuckle since just trivially modifying their example ... sort of worked Given: RUN apt-get update && exit 1 && apt-get install -y libnss3 libgtk-3-0 libx11-xcb1 libxss1 libasound2 It produced: - Next, apt-get is used to update the system and exit 1 is used to stop any further commands from running. - Then libnss3, libgtk-3-0, libx11-xcb1, libxss1, and libasound2 are installed using apt-get. For good fun, I tried another small edit RUN exit 1 && apt-get update && apt-get install -y libnss3 libgtk-3-0 libx11-xcb1 libxss1 libasound2 With an even better explanation: - The code then runs an exit command and uses apt-get to update its package list before installing libnss3, libgtk-3-0, libx11-xcb1, libxss1, and asound2.
- CyberShadow 5y ago
  I think having it produce good output on nonsensical / obviously wrong code would be a very different target than explaining commonly found code, so your expectation is a little unreasonable at this point.
  - mdaniel 5y ago
    Well, they're the ones that said "worst" and "most obscure," that wasn't me paraphrasing But my heartburn is the intersection of these two bullet points: "and exit 1 is used to stop any further commands from running", followed by _any other claim_ > obviously wrong code Based on my experience with code reviews, I'd bet $5 I could put (or leave) "&& exit 1 &&" in the middle of a sea of RUN commands and it'd go unnoticed. So I guess it depends on who the target audience is for both this and the absolutely laughable Labs output: people who don't want to read what an if statement does, or people looking for the _meaning_ of the code?
  - Aeolun 5y ago
    I think the explanation is just as correct as the code. Garbage in -> garbage out
- codeenlightener 5y ago
  Denigma works very poorly on short code– especially single lines. It warns you. It is designed for explaining real-world code in context, and performs poorly on esoteric examples.
  - mdaniel 5y ago
    In case it wasn't clear, I modified your DevOps example, so it's not like that code came out of left-field or was hand-crafted to trip you up. If you want to say "it is not good at reasoning about shell, instead focusing on programming languages" that'd be a much more plausible concession Since you're hanging out here, what is the explanation for how it can say "exit 1 is used to stop any further commands from running." and then carry on? It's even more bizarre that it (seems to?) understands what "exit 1" does, but only when it is not the first command in the sequence?

Almost certainly not --- That was also the first time I had heard of denigma.app and their tagline of We stress-tested it on the worst, most obscure code we could find. That's why we're confident it will work on your complex codebase. gave me a good chuckle since just trivially modifying their example ... sort of worked Given: RUN apt-get update && exit 1 && apt-get install -y libnss3 libgtk-3-0 libx11-xcb1 libxss1 libasound2 It produced: - Next, apt-get is used to update the system and exit 1 is used to stop any further commands from running. - Then libnss3, libgtk-3-0, libx11-xcb1, libxss1, and libasound2 are installed using apt-get. For good fun, I tried another small edit RUN exit 1 && apt-get update && apt-get install -y libnss3 libgtk-3-0 libx11-xcb1 libxss1 libasound2 With an even better explanation: - The code then runs an exit command and uses apt-get to update its package list before installing libnss3, libgtk-3-0, libx11-xcb1, libxss1, and asound2.

CyberShadow 5y ago
I think having it produce good output on nonsensical / obviously wrong code would be a very different target than explaining commonly found code, so your expectation is a little unreasonable at this point.
- mdaniel 5y ago
  Well, they're the ones that said "worst" and "most obscure," that wasn't me paraphrasing But my heartburn is the intersection of these two bullet points: "and exit 1 is used to stop any further commands from running", followed by _any other claim_ > obviously wrong code Based on my experience with code reviews, I'd bet $5 I could put (or leave) "&& exit 1 &&" in the middle of a sea of RUN commands and it'd go unnoticed. So I guess it depends on who the target audience is for both this and the absolutely laughable Labs output: people who don't want to read what an if statement does, or people looking for the _meaning_ of the code?
- Aeolun 5y ago
  I think the explanation is just as correct as the code. Garbage in -> garbage out
codeenlightener 5y ago
Denigma works very poorly on short code– especially single lines. It warns you. It is designed for explaining real-world code in context, and performs poorly on esoteric examples.
- mdaniel 5y ago
  In case it wasn't clear, I modified your DevOps example, so it's not like that code came out of left-field or was hand-crafted to trip you up. If you want to say "it is not good at reasoning about shell, instead focusing on programming languages" that'd be a much more plausible concession Since you're hanging out here, what is the explanation for how it can say "exit 1 is used to stop any further commands from running." and then carry on? It's even more bizarre that it (seems to?) understands what "exit 1" does, but only when it is not the first command in the sequence?