One problem here is that because of the complexity required to make a modern garbage collector manage memory effectively, when the GC fails to do its job proper

One problem here is that because of the complexity required to make a modern garbage collector manage memory effectively, when the GC fails to do its job properly it is far more complicated to fix ('optimise') than in a language with explicit allocation. The higher-level a language the less predictable its memory usage.