With ANNs all you are doing is matmul, addition, log, exp, cosine, sine, and indexing. I am saying “all” because all operations we are doing are reduced to a t

With ANNs all you are doing is matmul, addition, log, exp, cosine, sine, and indexing. I am saying “all” because all operations we are doing are reduced to a tree of just these operations. It turns out that these are enough, and that’s good because floating point units are limited. You don’t want to waste transistors on operations that don’t provide a lot of value.