Ignoring bandwidth issues for a moment, just getting multiple CPUs to play nice is a problem. Back in the day we called the concept -- large system effects. Or, which would you rather orchestrate pulling 500 lbs, 1,000 chickens or one elephant. Now add bandwidth to the equation and it becomes more complex.