ChatGPT答案评分系统
包含ChatGPT-4关于口腔种植修复问题的1800个答案，以及专家对可靠性和可重复性的评分，用于评估提示设计对LLM回答质量的影响。
基本信息
资源简介
ChatGPT答案评分系统
【一句话概览】
本数据集是 figshare 公开的文本数据集，收录 1 个文件、合计 5.63 KB，主题涵盖 point likert scale、totaling 1800 answers、generate reliable answers、experts assessed reliability、chatgpt &# 8217，可用于医学自然语言处理（实体识别、信息抽取等），CC BY 4.0 许可开放获取。
【数据集背景】
本数据集源站标题为《Grading system for answers generated by ChatGPT.》。源站首次发布：2025-05-30。
【数据内容】
源站原始描述：Language models (LLMs) such as ChatGPT are widely available to any dental professional. However, there is limited evidence to evaluate the reliability and reproducibility of ChatGPT-4 in relation to implant-supported prostheses, as well as the impact of prompt design on its responses. This constrains understanding of its application within this specific area of dentistry. The purpose of this study was to evaluate the performance of ChatGPT-4 in generating answers about implant-supported prosthes…
【数据结构与技术规格】
文件数 1 个，合计 5.63 KB。Table 3.xls：application/vnd.ms-excel，5.63 KB。数据集 DOI：10.1371/journal.pone.0323086.t003。
【主题与分类】
源站学科分类：Space Science、Microbiology、Molecular Biology、Physiology、Environmental Sciences not elsewhere classified、Biological Sciences not elsewhere classified。主题标签：point likert scale、totaling 1800 answers、generate reliable answers、experts assessed reliability、chatgpt &# 8217、answer generation performance、almost perfect repeatability、using specific prompts、almost perfect、specific prompts。
【适用方向】
文本类数据可用于医学自然语言处理，如命名实体识别、信息抽取与文本分类。
【获取与许可】
源站页面：https://plos.figshare.com/articles/dataset/Grading_system_for_answers_generated_by_ChatGPT_/29200254
使用许可：CC BY 4.0（https://creativecommons.org/licenses/by/4.0/）。
规范引用：Freire, Yolanda; Laorden, Andrea Santamaría; Pérez, Jaime Orejas; Collado, Ignacio Ortiz; Sánchez, Margarita Gómez; Vasallo, Israel J. Thuissard; et al. (2025). Grading system for answers generated by ChatGPT.. PLOS ONE. Dataset
下载信息
注册下载
需要注册 Kaggle 账号并登录后下载，适合需要跟踪下载记录和使用 API 的用户。
暂未开放公开下载
无需注册即可直接获取公开样本或文档，适合快速预览和评估数据集质量。
免登录有偿下载
公开数据集受托下载与技术交付服务。
提供高速下载与技术交付服务（收技术服务费，非数据销售）
暂未开放当前数据集主要来源为 Kaggle 公开托管，完整影像包建议通过原始链接或 Kaggle API 获取。
使用方式
数据集获取（Figshare）
- 源站标题：Grading system for answers generated by ChatGPT.
- DOI：10.1371/journal.pone.0323086.t003
- 发布日期：2025-05-30
- 文件数：1 个
- 文件总体积：5.63 KB
- 源站页面：https://plos.figshare.com/articles/dataset/Grading_system_for_answers_generated_by_ChatGPT_/29200254
命令行下载
curl -L -o "Table 3.xls" "https://ndownloader.figshare.com/files/54999351"
文件清单
Table 3.xls（5.63 KB）
文件总体积 5.63 KB（源站 API 实测）。
数据说明
Language models (LLMs) such as ChatGPT are widely available to any dental professional. However, there is limited evidence to evaluate the reliability and reproducibility of ChatGPT-4 in relation to implant-supported prostheses, as well as the impact of prompt design on its responses. This constrains understanding of its application within this specific area of dentistry. The purpose of this study was to evaluate the performance of ChatGPT-4 in generating answers about implant-supported prostheses using different prompts. Thirty questions on implant-supported and implant-retained prostheses were posed, with 30 answers generated per question using general and specific prompts, totaling 1800 answers. Experts assessed reliability (agreement with expert grading) and repeatability (response consistency) using a 3-point Likert scale. General prompts achieved 70.89% reliability, with repeatability ranging from moderate to almost perfect. Specific prompts showed higher performance, with 78.8% reliability and substantial to almost perfect repeatability. The specific prompt significantly improved reliability compared to the general prompt. Despite these promising results, ChatGPT’s ability to generate reliable answers on implant-supported prostheses remains limited, highlighting the need for professional oversight. Using specific prompts can enhance its performance. The use of a specific prompt might improve the answer generation performance of ChatGPT.
许可
CC BY 4.0
引用
学术使用请引用 DOI 10.1371/journal.pone.0323086.t003（source: https://plos.figshare.com/articles/dataset/Grading_system_for_answers_generated_by_ChatGPT_/29200254）。
数据缺失？
依托陕西、四川两大基地，我们与超过十家三甲医院建立直接合作关系，覆盖合规授权、采集治理、专业标注、数据交付的全流程，为AI医疗团队提供即拿即用的高质量临床数据。
⚡️ 需要数据支持或标注服务？立即联系我们获取专业方案。
