EVALUATION OF SCREEN-FILM COMBINATIONS BY RECEIVER OPERATING CHARACTERISTIC (ROC) CURVE
0
Citation
0
Reference
10
Related Paper
Abstract:
Receiver operating characteristic (ROC) curves have been used increasingly to evaluate radiographic imaging systems in terms of observer detection performance. In this study, we evaluate radiographic screed-film combinations by d'e and the maximum image information content (I_Keywords:
Observer (physics)
The area under the receiver operating characteristic (ROC) curve serves as one means for evaluating the performance of diagnostic and predictive test systems. The most commonly used method for estimating the area under an ROC curve utilizes the maximum-likelihood-estimation technique, and a nonparametric method to calculate the area under an ROC curve was recently described. We compared the performance of these two methods. The results for the area under the ROC curve and the standard error of the estimate as calculated by each of the two methods exhibited high correlation. Generally, the nonparametric method yields lower area estimates than the maximum-likelihood-estimation technique. However, these differences generally were small, particularly with ROC curves derived from five or more cutoff points. Consistent results of hypothesis testing of the significance of differences between two ROC curves will be similar, regardless of which method is used, as long as one uses the same estimation technique on the two curves and as long as the two ROC curves being compared are of similar shape.
Cut-off
Area under curve
Cite
Citations (139)
Performance metric
Cite
Citations (33)
Receiver operating characteristic (ROC) curves have been used increasingly to evaluate radiographic imaging systems in terms of observer detection performance. In this study, we evaluate radiographic screed-film combinations by d'e and the maximum image information content (I_) derived from ROC curves.
Observer (physics)
Cite
Citations (0)
Ordinal Scale
Cite
Citations (3,353)
What is the ROC Curve?Sensitivity and specificity, which are defined as the number of true positive decisions/the number of actually positive cases and the number of true negative decisions/the number of actually negative cases, respectively, constitute the basic measures of performance of diagnostic tests (Table 1).When the results of a test fall into one of two obviously defined categories, such as either the presence or absence of a disease, then the test has only one pair of sensitivity and specificity values.However, in many diagnostic situations, making a decision in a binary mode is both difficult and impractical.Image findings may not be obvious or clean-cut.There may be a considerable variation in the diagnostic confidence levels between the radiologists who interpret the findings.As a result, a single pair of sensitivity and specificity values is
Plot (graphics)
Cite
Citations (792)
This study reviewed the concepts and properties of the receiver operating characteristic (ROC) curve and precision recall (PR) curve, and made suggestions on the application of two curves based on the prevalence in combination with the results of simulation data. This study demonstrated that the ROC curve and PR curve had different properties, which could reflect the performance of diagnostic methods from various aspects. These two curves should be selected with a consideration of prevalence and clinical scenarios. When the prevalence was less than 20%, especially less than 5%, the PR curve could be adopted.本研究对受试者特征工作（ROC）曲线和查准率-查全（PR）曲线的概念和性质进行概括回顾，结合模拟数据结果，基于患病率对ROC曲线和PR曲线的应用做出建议。研究显示，ROC曲线和PR曲线具有不同的性质，可以从不同的侧面反映诊断方法的性能，应结合患病率和临床场景进行选择。当患病率小于20%，尤其是小于5%时，应重视PR曲线的应用。.
Area under curve
Cite
Citations (3)
Area under curve
Cite
Citations (7)
질병에 이환된 개체로부터 이환되지 않은 개체를 구분하기 위해 사용되는 대부분의 진단검사는 판별의 기준점 (cut-off value)을 필요로 한다. ROC (receiver operating characteristic) 곡선은 이러한 목적으로 흔히 사용되고 있으며 진단의 기준점을 다양하게 변화시킬 때 진단검사의 정확도 (민감도와 특이도)를 제시해주는 지표로 활용되고 있다. 저자들은 수의학관련 연구자들이 이 방법을 효과적으로 사용할 수 있도록 EXCEL에 내장된 비쥬얼 베이직으로 binormal ROC 곡선의 최대우도비를 계산해주는 프로그램을 작성하였다. 방사선 분야의 자료와 미생물학 자료를 예제로 들어 이 프로그램의 활용성을 높이고자 하였고 이 분야에 관심이 있는 연구자는 저자에게 연락하여 이 프로그램을 얻을 수 있다. 【Diagnostic tests often require the determination of cut-off values that discriminate uninfected from infected individuals. The receiver operating characteristic (ROC) curve has been frequently used to attain this purpose and gives a representation of diagnostic accuracy (sensitivity and specificity) of a prediction model when varying the cut-point of a decision rule on a whole spectrum. We have written and tested a visual basic application program in EXCEL for maximum likelihood estimation of a binormal ROC curve, which also computes univariate statistics of a diagnostic test employed. Examples applying for computed tomographic images in radiology and methicillin-resistant Staphylococcus aureus research are given to illustrate this approach. This stand-alone module is available from the first author on request.】
Univariate
Cite
Citations (1)
The area under the receiver operating characteristic (ROC) curve is a measure of discrimination ability used in diagnostic and prognostic research. The ROC plot is usually represented without additional information about decision thresholds used to generate the graph. In our article, we show that adding at least one or more informative cutoff points on the ROC graph facilitates the characterization of the test and the evaluation of the discriminatory capacities, which can result in more informed medical decisions. We use the rocreg and rocregplot commands.
Cut-off
Plot (graphics)
Cite
Citations (3)
The receiver operating characteristic (ROC) curve was applied to observer performances in a multiple-alternative decision task. It was shown that the probability of correct classification, a performance criterion often maximized in multiple-classification procedures, corresponds to the area under an appropriately constructed ROC curve. Degrees of confidence in the observer's judgment of 0, 1, ... , 10 were used for both classification and ROC rating. To demonstrate the validity of the method, 1,190 photofluorograms were examined by experi enced staff radiologists to identify four cardiovascular conditions distinguishable on the basis of images of structural elements of the contours of the heart and great vessels. The clas sification matrices for three radiologists who achieved high, medium, and low performance ratings in this experiment are reported. The ROC curves are symmetric, with their points located around the off-diagonal. Differences between the overall probability of correct clas sification and the ROC curve index calculated from the same evaluator's data were very small, 0.004 to 0.011. Key words: receiver operating characteristic (ROC) curve; multiple classification; medical decision making; cardiovascular diagnostics; thorax, radiography. (Med Decis Making 7:234-237, 1987)
Observer (physics)
Cite
Citations (13)