The ROC curve assesses the performance of classification methods used to identify observations by type. The ROC curve may indicate the performance of a forensic DNA test that classifies genetic samples as to whether or not they match. In order to produce an ROC curve, a sample of observations with known classes must be available. Often, the true ROC function may be a continuous curve that remains unknown. Statistical methods lead to smooth, parametric estimates of the true ROC function from the jagged empirical one. In order to measure the quality of smooth, parametric ROC function estimates, this research project developed a unique statistical goodness-of-fit test. Motivated by that development, the researchers have also created two original estimators of parametric ROC functions. Statistical inference with the ROC curve has traditionally been based on differences between empirical and parametric curves in the vertical direction. What is new and unique in the current work is the use of differences in a perpendicular direction for goodness-of-fit tests, function estimators, and confidence regions for the ROC curve. Working along directions perpendicular to parametric binormal ROC curve, researchers designed a goodness-of-fit test similar to existing statistics based on the empirical distribution function (EDF) for a single random variable. Through large simulations, this new test has exhibited uniformity of p-values under the null hypothesis, and consistency. The original function estimators developed in this work minimize differences in perpendicular directions between empirical and parametric ROC curves. 21 tables 20 figures, and approximately 70 bibliographic listings
Downloads
Similar Publications
- Assessing the Impact of Plea Bargaining on Subsequent Violence for Firearm Offenders
- Examining the Black Box: A Formative and Evaluability Assessment of Cross-Sectoral Approaches for Intimate Partner and Sexual Violence
- Evaluating the Effects of Co-response Teams in Reducing Subsequent Hospitalization: A Place-based Randomized Controlled Trial