This is exactly the intuition that leads to excitement about fine tuning. However, I personally think that this intuition applies to products and interfaces, n

This is exactly the intuition that leads to excitement about fine tuning. However, I personally think that this intuition applies to products and interfaces, not to AI. Intelligence and learning is general. Intelligence without generalization is memorization, which seems to be less useful in practice.