Title: Frequentist Validity of Epistemic Uncertainty Estimators Show Chinese title

Title: 频率学派有效性的情感不确定性估计量

Abstract: Decomposing prediction uncertainty into its aleatoric (irreducible) and epistemic (reducible) components is critical for the development and deployment of machine learning systems. A popular, principled measure for epistemic uncertainty is the mutual information between the response variable and model parameters. However, evaluating this measure requires access to the posterior distribution of the model parameters, which is challenging to compute. In view of this, we introduce a frequentist measure of epistemic uncertainty based on the bootstrap. Our main theoretical contribution is a novel asymptotic expansion that reveals that our proposed (frequentist) measure and the (Bayesian) mutual information are asymptotically equivalent. This provides frequentist interpretations to mutual information and new computational strategies for approximating it. Moreover, we link our proposed approach to the widely-used heuristic approach of deep ensembles, giving added perspective on their practical success. Show Chinese abstract

Abstract: 将预测不确定性分解为其随机性（不可减少）和知识性（可减少）成分对于机器学习系统的开发和部署至关重要。 一种流行且有原则性的知识性不确定性度量是响应变量与模型参数之间的互信息。 然而，评估这一度量需要访问模型参数的后验分布，这在计算上具有挑战性。 鉴于此，我们引入了一种基于引导法的频率学派知识性不确定性度量。 我们的主要理论贡献是一种新颖的渐近展开，揭示了我们提出的（频率学派）度量与（贝叶斯）互信息在渐近意义上是等价的。 这为互信息提供了频率学派解释，并为近似它提供了新的计算策略。 此外，我们将所提出的方法与广泛使用的深度集成启发式方法联系起来，为它们的实际成功提供了新的视角。