Quotation

“Uncertainty is a key aspect of human reasoning. Without uncertainty, we would never doubt ourselves or our decisions. We would be certain that we’re right all the time. It’s this certainty that can make an AI’s ability to learn turn brittle over time. But if an AI is uncertain and capable of doubt, it can begin to judge itself, to question whether an action or decision will have the consequence it desires and test it more thoroughly.”