What is black box AI?

A predictive tool that gives you outcomes without the reasons behind them.

A black box AI method for prediction here means a tool we can use to predict outcomes (provided sufficient relevant data), but which cannot be easily interrogated for insights into why a specific prediction was made.

Inductive bias is another concept which is worthy of discussion here. This can be thought of as information which is brought in which does not come from the data itself.

References and further reading

Hardwick, Robert J. 2025. “What can a simulation do that a prediction cannot?” umbralcalculations, November. https://umbralcalc.github.io/posts/what_can_a_simulation_do_that_a_prediction_cannot.html.
Rudin, Cynthia. 2019. “Stop Explaining Black Box Machine Learning Models for High Stakes Decisions and Use Interpretable Models Instead.” Nature Machine Intelligence 1 (5): 206–15. https://doi.org/10.1038/s42256-019-0048-x.