大语言模型在肌少症患者查询中的表现评估数据集
20个肌少症患者问题及三个LLM回答的专家评估表格,用于评估LLM在肌少症患者教育中的表现。

基本信息
资源简介
大语言模型在肌少症患者查询中的表现评估数据集
【一句话概览】
本数据集是 figshare 公开的文本数据集,收录 1 个文件、合计 230.93 KB,主题涵盖 ChatGPT、deepseek、Gemini、large language models、sarcopenia,可用于医学自然语言处理(实体识别、信息抽取等),CC BY 4.0 许可开放获取。
【数据集背景】
本数据集源站标题为《Table 1_Evaluating the performance of large language models in sarcopenia-related patient queries: a foundational assessment for patient-centered validation.docx》。配套论文《Large language models’ performances regarding common patient questions about osteoarthritis: A comparative analysis of ChatGPT-3.5, ChatGPT-4.0, and Perplexity》发表于 Journal of Sport and Health Science(2025),DOI:10.1016/j.jshs.2024.101016。源站首次发布:2026-03-18。
【数据内容】
源站原始描述:BackgroundLarge Language Models (LLMs) have shown promise in clinical applications but their performance in specialized areas such as sarcopenia remains understudied. MethodsA panel of sarcopenia clinician researchers developed 20 standardized patient-centered questions across six clinical domains. Each question was input into all three LLMs, and responses were anonymized, randomized, and independently assessed by three clinician researchers. Accuracy was graded on a four-point scale (“Poor” to…
【数据结构与技术规格】
文件数 1 个,合计 230.93 KB。Table 1_Evaluating the performance of large language models in sarcopenia-related patient queries: a foundational assessment for patient-centered vali.docx:application/vnd.openxmlformats-officedocument.wordprocessingml.document,230.93 KB。数据集 DOI:10.3389/fragi.2026.1712785.s001。
【主题与分类】
源站学科分类:Molecular Biology。主题标签:ChatGPT、deepseek、Gemini、large language models、sarcopenia。
【适用方向】
文本类数据可用于医学自然语言处理,如命名实体识别、信息抽取与文本分类。
【获取与许可】
源站页面:https://frontiersin.figshare.com/articles/dataset/Table_1_Evaluating_the_performance_of_large_language_models_in_sarcopenia-related_patient_queries_a_foundational_assessment_for_patient-centered_validation_docx/31800940
使用许可:CC BY 4.0(https://creativecommons.org/licenses/by/4.0/)。
规范引用:Huang, Tao; Kirk, Ben; Close, Jacqueline; Lim, Jae-young; Duque, Gustavo; Ebeling, Peter; et al. (2026). Table 1_Evaluating the performance of large language models in sarcopenia-related patient queries: a foundational assessment for patient-centered validation.docx. Frontiers. Dataset
下载信息
注册下载
需要注册 Kaggle 账号并登录后下载,适合需要跟踪下载记录和使用 API 的用户。
暂未开放公开下载
无需注册即可直接获取公开样本或文档,适合快速预览和评估数据集质量。
免登录当前数据集主要来源为 Kaggle 公开托管,完整影像包建议通过原始链接或 Kaggle API 获取。
使用方式
数据集获取(Figshare)
- 源站标题:Table 1_Evaluating the performance of large language models in sarcopenia-related patient queries: a foundational assessment for patient-centered validation.docx
- DOI:10.3389/fragi.2026.1712785.s001
- 发布日期:2026-03-18
- 文件数:1 个
- 文件总体积:230.93 KB
- 源站页面:https://frontiersin.figshare.com/articles/dataset/Table_1_Evaluating_the_performance_of_large_language_models_in_sarcopenia-related_patient_queries_a_foundational_assessment_for_patient-centered_validation_docx/31800940
命令行下载
curl -L -o "Table 1_Evaluating the performance of large language models in sarcopenia-related patient queries: a foundational assessment for patient-centered vali.docx" "https://ndownloader.figshare.com/files/62915878"
文件清单
Table 1_Evaluating the performance of large language models in sarcopenia-related patient queries: a foundational assessment for patient-centered vali.docx(230.93 KB)
文件总体积 230.93 KB(源站 API 实测)。
数据说明
BackgroundLarge Language Models (LLMs) have shown promise in clinical applications but their performance in specialized areas such as sarcopenia remains understudied.
MethodsA panel of sarcopenia clinician researchers developed 20 standardized patient-centered questions across six clinical domains. Each question was input into all three LLMs, and responses were anonymized, randomized, and independently assessed by three clinician researchers. Accuracy was graded on a four-point scale (“Poor” to “Excellent”), and comprehensiveness was evaluated for responses rated “Good” or higher using a five-point scale.
ResultsAll LLMs achieved good performance, with no responses rated “Poor” across any domain. Deepseek had the longest and most detailed responses (mean word count: 583.75 ± 71.89) and showed superior performance in “risk factors” and “prognosis.” ChatGPT provided the most concise replies (359.5 ± 87.89 words, p = 0.0011) but achieved the highest proportion of “Good” ratings (90%). Gemini excelled in “pathogenesis” and “diagnosis” but received the most critical feedback in “prevention and treatment.” Although trends in performance differences were noted, they did not reach statistical significance. Mean comprehensiveness scores were also similar across models (Deepseek: 4.017 ± 0.77, Gemini: 3.97 ± 0.88, ChatGPT: 3.953 ± 0.83; p > 0.05).
ConclusionDespite minor differences in performance across domains, all three LLMs demonstrated acceptable accuracy and comprehensiveness when responding to sarcopenia-related queries. Their comparable results may reflect similarly recent training data and language capabilities. These findings suggest that LLMs could potentially serve as a valuable tool in patient education and care on sarcopenia. This study provides an initial, expert-based assessment of LLM information quality regarding sarcopenia. While the responses demonstrated good accuracy, this evaluation focuses on content correctness from a clinical perspective. Future research must complement these findings by directly engaging older adult cohorts before clinical implementation can be considered. However, human oversight remains essential to ensure safe and appropriate
许可
CC BY 4.0
引用
学术使用请引用 DOI 10.3389/fragi.2026.1712785.s001(source: https://frontiersin.figshare.com/articles/dataset/Table_1_Evaluating_the_performance_of_large_language_models_in_sarcopenia-related_patient_queries_a_foundational_assessment_for_patient-centered_validation_docx/31800940)。
需要用于商业化训练或医疗器械注册(NMPA/FDA)?
公开数据往往缺乏完整的病理回证与专家标注。千方医数集依托陕川双基地与超十家三甲医院直连,提供完全合规、去标识化、支持注册级质控的专病数据集交易服务。




