Systematic errors in estimation of gravitational-wave candidate significance

Document #:

LIGO-P1500247-v3

Document type:

P - Publications

Abstract:

We investigate a critical issue in determining the statistical significance of candidate transient gravitational-wave events in a ground-based interferometer network. Given the presence of non-Gaussian noise artefacts in real data, the noise background must be estimated empirically from the data itself. However, the data also potentially contains signals, thus the background estimate may be overstated due to contributions from signals. It has been proposed to mitigate possible bias by removing single-detector data samples that pass a multi-detector consistency test (and thus form coincident events) from the background estimates. We conduct a high-statistics Mock Data Challenge to evaluate the effects of removing such samples, modeling a range of scenarios with plausible detector noise distributions and with a range of plausible foreground astrophysical signal rates; thus, we are able to calculate the exact false alarm probabilities of candidate events in the chosen noise distributions. Three slightly different algorithms for calculating the false alarm probability of candidate events are each deployed in two different modes: one in which coincident samples are removed and one in which all samples are retained and used. The three algorithms show good consistency with each other; however, discrepancies arise between the results obtained under the ‘coincidence removal’ and ‘all samples’ modes, for false alarm probabilities below a certain value. In most scenarios the median of the false alarm probability (FAP) estimator under the ‘all samples’ mode is consistent with the exact FAP. On the other hand the ‘coincidence removal’ mode is found to be unbiased for the mean of the estimated FAP over realizations. While the numerical values at which discrepancies become apparent are specific to the details of our numerical experiment, we believe that the qualitative differences in the behaviour of the median and mean of the FAP estimator have more general validity. On the basis of our study we suggest that the FAP of candidates for the first detection of gravitational waves should be estimated without removing single-detector samples that form coincidences.

Files in Document:

• long significance doc (sig_paper.pdf, 1.5 MB)

Topics:

• Data Analysis
• Data analysis software
• Compact Binaries

Authors:

• Yiming Hu
• Chris Messenger
• Collin Capano
• Thomas Dent
• Chad Hanna
• Martin Hendry
• John Veitch

Keywords:

significance false alarm probability detection confidence background foreground MDC

Notes and Changes:

Revised longer version, now no longer under consideration for publication, but to be referred to as a technical document from a considerably shorter version which will be submitted to the journal.