When you're trying to sell everyone - including yourself - on your superior rationality, it might be considered a feature and not a bug.
What would be ironic would a solarpunk maximiser AI that forced humans to stop doing that shit because it's stupid and self-harming and there are better alternatives.
And the only real cost would be loss of face and status for less than 1% of the population.
Maybe that's not rational either. Hard to tell until it's been tried.
I can't find it but there's a short story on the super-cognition trope, but oriented along the lines of human cognition. What struck me about it is that ultimately the point of view character is the bad guy for these sorts of reasons.
No, the point is that despite his superintelligence, he's ultimately selfish - what he obsesses over is achieving ever higher organization of knowledge and its implications, rather then wanting or trying to apply his discoveries practically to help other - i.e. he comes up with how to build an anti-gravity device with present day technology, but doesn't think that's very interesting because now discovered he knows it will work and its implementation wouldn't contribute to his greater understanding and organization of knowledge.
The opposition who takes him down is the opposite: after concluding how to build efficient fusion generators, his premise is further thought is not needed until the solution has been implemented - and his plan is to set out to apply his conclusions to uplifting the world.
Of course the opposition isn't "good" per se - he's still going to use the ability to out-think everyone to accomplish some measure of enslavement, but the plan at least is to try and improve the world for all humankind.
In a practical sense to the rest of us of course, the future reality was going to be alien cognizances subjugating the world in one way or another.
Selfishness in this context is a balance between different forms of self-identification. e.g. national identity is a new invention designed to foster cooperation over previous bounds of identification. If it worked once, why not try it again...?
Lack of cooperation on Earth is a bloody affair for the constrained resources, so an intergalactic campaign under the same assumption may lead to advanced alien cognition desiring to expand our sense of self. I.e. if multiple timelike dimensions exist then our survival mechanism is maladapted to that topology. If you discover this constraint expansion on your own, it is freedom. If you are told, it is subjugation. ...or so I muse.
And on other end you have 40k AI. That rightfully decide that overall best actions is to get rid off humans... Purely from utilitarian perspective against Chaos.
The other day my SO and I were pondering a story wherein aliens visit, and essentially say “oh hey you sure have a bad case of capitalism! We had one too, here’s how to break it, we’ve helped about a hundred planets get though it now.” Same idea. Wish I had the faintest idea what strategies they’d present to make that happen.
Well, the reason we can't really experiment with other options is because very wealthy people use the US to kill (often literally) alternative approaches. The 70s and 80s were full of US black ops to collapse socialist governments in South America.
What would be ironic would a solarpunk maximiser AI that forced humans to stop doing that shit because it's stupid and self-harming and there are better alternatives.
And the only real cost would be loss of face and status for less than 1% of the population.
Maybe that's not rational either. Hard to tell until it's been tried.