Estimating the number of true null hypotheses from a histogram of p values
Hwang, J.T. Gene
In an earlier article, an intuitively appealing method for estimating the number of true null hypotheses in a multiple test situation was proposed. That article presented an iterative algorithm that relies on a histogram of observed p values to obtain the estimator. We characterize the limit of that iterative algorithm and show that the estimator can be computed directly without iteration. We compare the performance of the histogram-based estimator with other procedures for estimating the number of true null hypotheses from a collection of observed p values and find that the histogram-based estimator performs well in settings similar to those encountered in microarray data analysis. We demonstrate the approach using p values from a large microarray experiment aimed at uncovering molecular mechanisms of barley resistance to a fungal pathogen.
This article is published as Nettleton, Dan, JT Gene Hwang, Rico A. Caldo, and Roger P. Wise. "Estimating the number of true null hypotheses from a histogram of p values." Journal of agricultural, biological, and environmental statistics 11, no. 3 (2006): 337. doi: 10.1198/108571106X129135.