Do you mean in the same way that any mathematical function is a compression engine? That is, you implement something that can handle many cases (1+1, 2+3, 5+6)

Do you mean in the same way that any mathematical function is a compression engine? That is, you implement something that can handle many cases (1+1, 2+3, 5+6) in a concise form? It seems to me like the real magic of neural networks is that they make it easier to search for a function that solves (to some extent) a particular problem.