Valid predictions of group-level random effects

File

2022-Niemi-ValidPredictionsPreprint.pdf (449.24 KB)

Date

2022-02-07

Authors

Niemi, Jarad
Miguez, Fernando
Niemi, Jarad

Publisher

Altmetrics

Authors

Niemi, Jarad

Person

Organizational Units

Agronomy

Organizational Unit

Statistics

Organizational Unit

Department

AgronomyStatistics

Abstract

Gaussian linear models with random group-level effects are the standard for modeling randomized experiments carried out over groups, such as locations, farms, hospitals, or schools. Group-level effects can be summarized by prediction intervals for group-level means or responses, but the quality of such summaries depends on whether the intervals are valid in the sense they attain their nominal coverage probability. Many methods for constructing prediction intervals are available -- such as Student's t, bootstrap, and Bayesian methods -- but none of these are guaranteed to be valid, and indeed are not valid over a range of simulation examples. We propose a new method for constructing valid predictions of group-level effects based on an inferential model (IM). The proposed prediction intervals have guaranteed finite-sample validity and outperform existing methods in simulation examples. In an on-farm agricultural study the new IM-based prediction intervals suggest a higher level of uncertainty in farm-specific effects compared to the standard Student's t-based intervals, which are known to undercover.

Comments

This preprint is made available through arXiv at doi:10.48550/arXiv.2202.01848. This work is licensed under a Creative Commons Attribution 4.0 License.

Keywords

Inferential model, Meta-analysis, Prediction interval, Random effect