Feature Attribution Stability Suite: How Stable Are Post-Hoc Attributions?
Researchers introduce the Feature Attribution Stability Suite to evaluate the stability of post-hoc feature attribution methods under realistic input perturbations
- Identify the limitations of existing metrics for evaluating feature attribution stability
- Develop a suite of metrics that condition on prediction preservation and capture explanation fragility separately from model sensitivity
- Apply the Feature Attribution Stability Suite to various post-hoc feature attribution methods and evaluate their performance under realistic input perturbations
- Analyze the results to determine the stability of different feature attribution methods and identify areas for improvement
Machine learning researchers and engineers working on safety-critical vision systems can benefit from this research to improve the reliability of their models, while data scientists and AI engineers can apply these methods to evaluate the stability of their own feature attribution methods
💡 The stability of post-hoc feature attribution methods is crucial for safety-critical vision systems and can be evaluated using a suite of metrics that condition on prediction preservation
🚨 Improve reliability of safety-critical vision systems with the Feature Attribution Stability Suite! 🚨
Key Takeaways
Researchers introduce the Feature Attribution Stability Suite to evaluate the stability of post-hoc feature attribution methods under realistic input perturbations
Full Article
Abstract:
arXiv:2604.02532v1 Announce Type: cross Abstract: Post-hoc feature attribution methods are widely deployed in safety-critical vision systems, yet their stability under realistic input perturbations remains poorly characterized. Existing metrics evaluate explanations primarily under additive noise, collapse stability to a single scalar, and fail to condition on prediction preservation, conflating explanation fragility with model sensitivity. We introduce the Feature Attribution Stability Suite (F
DeepCamp AI