There's also neglecting that a corporation can spend millions of person-hours a year on problems. No individual line of code produced by a FAAMG is superhuman,

There's also neglecting that a corporation can spend millions of person-hours a year on problems. No individual line of code produced by a FAAMG is superhuman, but producing codebases of billions of lines of code is definitely outside the ability of any lone human. If you find yourself in court facing a corporation, you'll learn they can spend multiple human lifetimes learning relevant precedents, processing discovered evidence, and constructing their arguments. It may not be runaway ever-improving superhuman AI, but pretending it is only as intelligent as the humans that make it up is missing the forests for the trees.