Sources of Explanation Uncertainty in Deep Learning Emulators of the Fire Weather Index
Explainable artificial intelligence can help interpret deep learning models of environmental processes, but the reliability of these explanations remains difficult to assess. Models with similar predictive skill may produce different explanations, and agreement across methods does not necessarily indicate accurate recovery of the underlying relationships. We propose using the Canadian Fire Weather Index System as a controlled benchmark to investigate the sources of explanation uncertainty and the role of correlated feature proxies. Its known mathematical structure provides a reference for assessing whether explanations recover the dependencies used to calculate the index.
