None of what you said seems different from how scaling software and data processing. Only the constant factors are different. Communication overhead is a major

None of what you said seems different from how scaling software and data processing. Only the constant factors are different. Communication overhead is a major concern in supercomputing / distributed commuting. 10x-100x scaleups require rearchitecture. Google Talk is not as cannot be same code as "UNIX talk"