Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Prediction-Based Model Selection for Bayesian Multiple Regression Models

Published

Author(s)

Adam L. Pintar

Abstract

Model selection is an important part of model building for Bayesian linear models when the number of possible model terms is large. Most current approaches focus on posterior model probabilities or the deviance information criterion. This article proposes an alternative strategy that considers how the model will be used after it is selected and chooses models based on their predictive ability over a user-speci ed portion of the covariate space de ned by a joint probability distribution called the distribution of interest. Because it is difficult to summarize the "goodness" of a model with a single number, we present a suite of numerical and graphical tools for detailed comparisons of different models. These tools help select a best model or a collection of good models based on their prediction performances over covariate locations likely to arise from the distribution of interest. The proposed method is illustrated with two examples. The rst example motivates and illustrates the new method, while the second example considers what to do when comparing thousands of models. Simulation results demonstrate where the new method produces improvements in prediction ability over some existing methods.
Citation
Bayesian Analysis

Keywords

Variable Selection, Deviance Information Criterion, Posterior Probability, Bayesian Model Averaging, Correlated Variables.

Citation

Pintar, A. (2013), Prediction-Based Model Selection for Bayesian Multiple Regression Models, Bayesian Analysis, [online], https://tsapps.nist.gov/publication/get_pdf.cfm?pub_id=909846 (Accessed March 29, 2024)
Created February 5, 2013, Updated January 27, 2020