The Black Box Challenge is one of the most paradigm-shifting consequences of AI, as it upends our well-established reliance on explainability and understanding. Given the complexity of currently available and in all likelihood future models, the starting point should be an acknowledgement how little we can understand about how many AI models produce their outputs, an acceptance that new ways of thinking will be required, and a regulatory approach that accounts for the impossibility of total explainability.