4 ms·

I'm only into infosec as a hobby, but I already find LLMs extremely useful and (annoyigly!) better than me at certain things. For instance, I can analyse some

• moonchrome 3y ago
  If it's anything like LLM for code review then I'd say it's not very potent. No doubt it's good at paraphrasing code, deobfuscation sound like a good usecase. Other than that I've seen it mostly come up with bullshit : - random opinions stated as fact (x makes code readable, y makes code simpler to understand, yada yada) - it's like a review from a mid level dev that finished reading Uncle Bob or some crap like that and suddenly there's 8 functions where there should be 2 - suggests changes that make the code subtly incorrect - like rewriting code with a different container type and messing up result ordering - state false information like suggesting that a dictionary will be faster than array search (for fixed size/small array), or that some approach is faster because it doesn't allocate (but original didn't allocate either and the new approach actually does, it just hides it in a container), etc. - can't catch complex logic bugs for shit, even with leading follow-up questions (once I figured out the problem and went back to see how long it would take GPT to figure it out)