大语言模型在肌少症患者查询中的表现评估数据集

20个肌少症患者问题及三个LLM回答的专家评估表格,用于评估LLM在肌少症患者教育中的表现。

NIAID Data Ecosystem
浏览 17
文本ChatGPTdeepseekGeminilarge language modelssarcopenia
Evaluating the performance of large language models in sarcopenia-related patient queries

基本信息

模态
文本
大小
0.000230925 GB
许可
CC BY 4.0
创建/更新时间
2026-10-09
版本
v1

资源简介

大语言模型在肌少症患者查询中的表现评估数据集

【一句话概览】

本数据集是 figshare 公开的文本数据集,收录 1 个文件、合计 230.93 KB,主题涵盖 ChatGPT、deepseek、Gemini、large language models、sarcopenia,可用于医学自然语言处理(实体识别、信息抽取等),CC BY 4.0 许可开放获取。

【数据集背景】

本数据集源站标题为《Table 1_Evaluating the performance of large language models in sarcopenia-related patient queries: a foundational assessment for patient-centered validation.docx》。配套论文《Large language models’ performances regarding common patient questions about osteoarthritis: A comparative analysis of ChatGPT-3.5, ChatGPT-4.0, and Perplexity》发表于 Journal of Sport and Health Science(2025),DOI:10.1016/j.jshs.2024.101016。源站首次发布:2026-03-18。

【数据内容】

源站原始描述:BackgroundLarge Language Models (LLMs) have shown promise in clinical applications but their performance in specialized areas such as sarcopenia remains understudied. MethodsA panel of sarcopenia clinician researchers developed 20 standardized patient-centered questions across six clinical domains. Each question was input into all three LLMs, and responses were anonymized, randomized, and independently assessed by three clinician researchers. Accuracy was graded on a four-point scale (“Poor” to…

【数据结构与技术规格】

文件数 1 个,合计 230.93 KB。Table 1_Evaluating the performance of large language models in sarcopenia-related patient queries: a foundational assessment for patient-centered vali.docx:application/vnd.openxmlformats-officedocument.wordprocessingml.document,230.93 KB。数据集 DOI:10.3389/fragi.2026.1712785.s001。

【主题与分类】

源站学科分类:Molecular Biology。主题标签:ChatGPT、deepseek、Gemini、large language models、sarcopenia。

【适用方向】

文本类数据可用于医学自然语言处理,如命名实体识别、信息抽取与文本分类。

【获取与许可】

源站页面:https://frontiersin.figshare.com/articles/dataset/Table_1_Evaluating_the_performance_of_large_language_models_in_sarcopenia-related_patient_queries_a_foundational_assessment_for_patient-centered_validation_docx/31800940

使用许可:CC BY 4.0(https://creativecommons.org/licenses/by/4.0/)。

规范引用:Huang, Tao; Kirk, Ben; Close, Jacqueline; Lim, Jae-young; Duque, Gustavo; Ebeling, Peter; et al. (2026). Table 1_Evaluating the performance of large language models in sarcopenia-related patient queries: a foundational assessment for patient-centered validation.docx. Frontiers. Dataset

官方服务

专家保障全链路合规授权与标注交付

陕川双基地 × 超十家三甲医院直连

从合规授权、采集治理、专业标注到数据集交付,我们提供全链路闭环服务,让高质量临床数据即拿即用。

⚡️ 需要原始数据或标注支持?联系我们获取定制方案。

帮我联系

下载信息

注册下载

需要注册 Kaggle 账号并登录后下载,适合需要跟踪下载记录和使用 API 的用户。

暂未开放

公开下载

无需注册即可直接获取公开样本或文档,适合快速预览和评估数据集质量。

免登录

当前数据集主要来源为 Kaggle 公开托管,完整影像包建议通过原始链接或 Kaggle API 获取。

免费样本无法满足模型训练要求?千方提供经三甲医院脱敏、带病理回证与专家标注的商业级专病数据集。

使用方式

数据集获取(Figshare)

命令行下载

curl -L -o "Table 1_Evaluating the performance of large language models in sarcopenia-related patient queries: a foundational assessment for patient-centered vali.docx" "https://ndownloader.figshare.com/files/62915878"

文件清单

  • Table 1_Evaluating the performance of large language models in sarcopenia-related patient queries: a foundational assessment for patient-centered vali.docx(230.93 KB)

文件总体积 230.93 KB(源站 API 实测)。

数据说明

BackgroundLarge Language Models (LLMs) have shown promise in clinical applications but their performance in specialized areas such as sarcopenia remains understudied.
MethodsA panel of sarcopenia clinician researchers developed 20 standardized patient-centered questions across six clinical domains. Each question was input into all three LLMs, and responses were anonymized, randomized, and independently assessed by three clinician researchers. Accuracy was graded on a four-point scale (“Poor” to “Excellent”), and comprehensiveness was evaluated for responses rated “Good” or higher using a five-point scale.
ResultsAll LLMs achieved good performance, with no responses rated “Poor” across any domain. Deepseek had the longest and most detailed responses (mean word count: 583.75 ± 71.89) and showed superior performance in “risk factors” and “prognosis.” ChatGPT provided the most concise replies (359.5 ± 87.89 words, p = 0.0011) but achieved the highest proportion of “Good” ratings (90%). Gemini excelled in “pathogenesis” and “diagnosis” but received the most critical feedback in “prevention and treatment.” Although trends in performance differences were noted, they did not reach statistical significance. Mean comprehensiveness scores were also similar across models (Deepseek: 4.017 ± 0.77, Gemini: 3.97 ± 0.88, ChatGPT: 3.953 ± 0.83; p > 0.05).
ConclusionDespite minor differences in performance across domains, all three LLMs demonstrated acceptable accuracy and comprehensiveness when responding to sarcopenia-related queries. Their comparable results may reflect similarly recent training data and language capabilities. These findings suggest that LLMs could potentially serve as a valuable tool in patient education and care on sarcopenia. This study provides an initial, expert-based assessment of LLM information quality regarding sarcopenia. While the responses demonstrated good accuracy, this evaluation focuses on content correctness from a clinical perspective. Future research must complement these findings by directly engaging older adult cohorts before clinical implementation can be considered. However, human oversight remains essential to ensure safe and appropriate

许可

CC BY 4.0

引用

学术使用请引用 DOI 10.3389/fragi.2026.1712785.s001(source: https://frontiersin.figshare.com/articles/dataset/Table_1_Evaluating_the_performance_of_large_language_models_in_sarcopenia-related_patient_queries_a_foundational_assessment_for_patient-centered_validation_docx/31800940)。

需要用于商业化训练或医疗器械注册(NMPA/FDA)?

公开数据往往缺乏完整的病理回证与专家标注。千方医数集依托陕川双基地与超十家三甲医院直连,提供完全合规、去标识化、支持注册级质控的专病数据集交易服务。