使用Youden's J阈值的错误率

数据集获取（Figshare）

• 源站标题：<p>Error Rates Using Youden’s J Threshold.</p>
• DOI：10.1371/journal.pdig.0001231.t002
• 发布日期：2026-02-26
• 文件数：1 个
• 文件总体积：5.63 KB
• 源站页面：https://plos.figshare.com/articles/dataset/_p_Error_Rates_Using_Youden_s_J_Threshold_p_/31426109

命令行下载

curl -L -o "Table 2.xls" "https://ndownloader.figshare.com/files/62201348"

文件清单

• Table 2.xls（5.63 KB）

文件总体积 5.63 KB（源站 API 实测）。

数据说明

AI has been proposed as a triage or “rule-out” device to reduce radiologist workload, but it is presently unclear how an AI “rule-out” threshold should be determined. We present a framework for determining an optimal threshold. Using a retrospective study design, 114,229 bilateral 2D digital screening mammograms were analyzed from 2006-2023 at a single study site. All mammograms were given an AI score using Mirai, an open-source deep-learning model which provides a 1-year risk score. Several metrics were examined using two thresholds for determining ruled out versus retained cases: 1) Caseload Reduction Rate (CRR; percent of caseload reduced due to rule-out), 2) Gross AI False Omission Rate (G-FOR; probability of a patient having breast cancer if ruled out), 3) AI Net False Omission Rate (N-FOR; probability of a patient having breast cancer if ruled out and the radiologist would have caught in standard care [i.e., no triage]), 4) AI Adjusted Net False Omission Rate (30%) (AN-FOR[30%]; N-FOR adjusted for the hypothetical scenario where radiologists detect an extra 30% of breast cancers among AI retained cases). The two thresholds were risk scores of 0.2 (Youden’s J) and 0.05 (AN-FOR[30%]=0). The former is mathematically optimal; the latter reflects a threshold where AI “rule-out” does not introduce any total increase in False Negatives. At the 0.20 threshold, G-FOR, N-FOR, and AN-FOR (30%) are 0.26%, 0.17%, and 0.14%, respectively (223, 141, and 121, respectively, missed cancer cases) and CRR = 75%. At the 0.05 threshold, the G-FOR, N-FOR, and AN-FOR (30%) are 0.12%, 0.07%, and 0.00% (49, 30, and 0, respectively, missed cancer cases) and CRR = 36%. We demonstrate how radiology practices can consider the trade-offs of using different AI scores as “rule-out” thresholds. At the AN-FOR rate of 30%, the Youden’s J threshold results in 121 additional missed cancers for a 75% caseload reduction. We estimate no additional missed cancers at a 36% caseload reduction.

许可

CC BY 4.0

引用

学术使用请引用 DOI 10.1371/journal.pdig.0001231.t002（source: https://plos.figshare.com/articles/dataset/_p_Error_Rates_Using_Youden_s_J_Threshold_p_/31426109）。