9.12 Trade-Off: Prediction Accuracy vs. Model Interpretability

  • Low flexibility: Better interpretation if aim is inference (association between predictor and outcome) BUT potentially worse prediction
  • High flexibility: Can also yield worse predictions because of overfitting (counterintuitive!)


James, Gareth, Daniela Witten, Trevor Hastie, and Robert Tibshirani. 2013. An Introduction to Statistical Learning: With Applications in R. Springer Texts in Statistics. Springer.