COMPARISON OF RECEIVER OPERATING CHARACTERISTIC AND FORCED-CHOICE OBSERVER PERFORMANCE-MEASUREMENT METHODS

被引:200
作者
BURGESS, AE
机构
[1] Center for Imaging Science, Rochester Institute of Technology, Rochester
关键词
EFFICIENCY; FORCED-CHOICE; OBSERVER PERFORMANCE; ROC; SAMPLING STATISTICS; SIGNAL DETECTION;
D O I
10.1118/1.597576
中图分类号
R8 [特种医学]; R445 [影像诊断学];
学科分类号
1002 ; 100207 ; 1009 ;
摘要
The receiver operating characteristic (ROC) method has been successfully used in medical imaging for 20 years. It has been so successful that many people think of it as an end in itself rather than just one of several ways to assess human observer performance of image based decision tasks. Studies of human and ideal observer decision performance are designed to estimate a measure of observer performance (e.g., efficiency, dfor da). The experimenter would like to obtain accurate and precise estimates using a relatively small number of images or decision trials because of a variety of constraints. One purpose of this paper is to introduce medical physicists to another effective psychophysical measurement technique, the forced choice method. The second purpose is to present a comparison of the forced choice and ROC methods, with particular attention to sampling statistics considerations. In brief, the rating scale ROC method is preferable when the limiting constraint is the number of images and at the same time it is not feasible to use the forced choice with more than four alternatives. The forced choice method can be superior for experiments using synthetic images, under some conditions. © 1995, American Association of Physicists in Medicine. All rights reserved.
引用
收藏
页码:643 / 655
页数:13
相关论文
共 28 条
[1]  
Abramowitz M., 1964, NBS SERIES, V55
[2]   AREA ABOVE ORDINAL DOMINANCE GRAPH AND AREA BELOW RECEIVER OPERATING CHARACTERISTIC GRAPH [J].
BAMBER, D .
JOURNAL OF MATHEMATICAL PSYCHOLOGY, 1975, 12 (04) :387-415
[3]   OBJECTIVE ASSESSMENT OF IMAGE QUALITY - EFFECTS OF QUANTUM NOISE AND OBJECT VARIABILITY [J].
BARRETT, HH .
JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION, 1990, 7 (07) :1266-1278
[4]  
BROWN DG, 1989, SPIE P, V1090, P154
[5]   VISUAL SIGNAL-DETECTION .1. ABILITY TO USE PHASE INFORMATION [J].
BURGESS, A ;
GHANDEHARIAN, H .
JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION, 1984, 1 (08) :900-905
[7]   EFFICIENCY OF HUMAN VISUAL SIGNAL DISCRIMINATION [J].
BURGESS, AE ;
WAGNER, RF ;
JENNINGS, RJ ;
BARLOW, HB .
SCIENCE, 1981, 214 (4516) :93-94
[8]   VISUAL SIGNAL-DETECTION .2. SIGNAL-LOCATION IDENTIFICATION [J].
BURGESS, AE ;
GHANDEHARIAN, H .
JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION, 1984, 1 (08) :906-910
[9]  
ELLIOTT PB, 1964, SIGNAL DETECT RECOG, P651
[10]   EFFECT OF PIXEL SIZE ON DETECTABILITY OF LOW-CONTRAST SIGNALS IN DIGITAL RADIOGRAPHY [J].
GIGER, ML ;
DOI, K .
JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION, 1987, 4 (05) :966-975