I was thinking mini-kidneys, mini-hearts? The latter might involve difficult coordination, but maybe that's not necessary if you've got individual hearts running at lower blood pressure.
It all just reminds me of Neal Asher's stories, where creatures build nano factories in their bodies as and when needed, including local fusion "nodes".
I think there's a lot of parts in the brain that involve day to day coordinations that could be moved out. Fine motor control stuff in the cerebellum probably wouldn't hurt if it's closer to the muscles, but the cerebrum might be harder to split up and scatter because of latency and bandwidth. On the other hand, we could go from dual core in the cranium to multicore distributed - like octop(uses|i) have one brain per arm and I believe another to rule them all.