> Semi-related, if you made a giant brainlike calculator out of water pipes and valves and shit, and asked it a question, then turned all its pipes and valves for a while... it would probably just say "please kill me."
Well it would kind of be a brain trapped in sensory deprived hell.
The point is I think people would expect pretty mundane things from a giant "mechanical" brain, but as described, it would be very unpredictable and complex. It would do things that instantly make the experimenters uneasy.
Um why? Most humans don't do that.