NIST logo

Publication Citation: Prediction-Based Model Selection For Bayesian Multiple Regression Models

NIST Authors in Bold

Author(s): Adam L. Pintar;
Title: Prediction-Based Model Selection For Bayesian Multiple Regression Models
Published: February 05, 2013
Abstract: Model selection is an important part of model building for Bayesian linear models when the number of possible model terms is large. Most current approaches focus on posterior model probabilities or the deviance information criterion. This article proposes an alternative strategy that considers how the model will be used after it is selected and chooses models based on their predictive ability over a user-speci ed portion of the covariate space de ned by a joint probability distribution called the distribution of interest. Because it is difficult to summarize the "goodness" of a model with a single number, we present a suite of numerical and graphical tools for detailed comparisons of different models. These tools help select a best model or a collection of good models based on their prediction performances over covariate locations likely to arise from the distribution of interest. The proposed method is illustrated with two examples. The rst example motivates and illustrates the new method, while the second example considers what to do when comparing thousands of models. Simulation results demonstrate where the new method produces improvements in prediction ability over some existing methods.
Citation: Bayesian Analysis
Keywords: Variable Selection; Deviance Information Criterion; Posterior Probability; Bayesian Model Averaging; Correlated Variables.
Research Areas: Statistics
PDF version: PDF Document Click here to retrieve PDF version of paper (409KB)