It reminds me of how AI will estimate that a coding project will take "4 weeks" and then proceed to finish the task itself in 15 minutes.

AI models are changing the world much faster than their own training can keep up with.