大型语言模型在干眼症中的应用：Perplexity AI与ChatGPT4比较

数据集获取（Figshare）

• 源站标题：Large Language Models Use in Dry Eye Disease: Perplexity AI versus ChatGPT4
• DOI：10.6084/m9.figshare.29944590.v1
• 发布日期：2025-08-19
• 文件数：3 个
• 文件总体积：99.73 KB
• 源站页面：https://tandf.figshare.com/articles/dataset/Large_Language_Models_Use_in_Dry_Eye_Disease_Perplexity_AI_versus_ChatGPT4/29944590

命令行下载

curl -L -o "isio_a_2547077_sm9436.docx" "https://ndownloader.figshare.com/files/57294045"
curl -L -o "isio_a_2547077_sm9435.docx" "https://ndownloader.figshare.com/files/57294048"
curl -L -o "isio_a_2547077_sm9434.docx" "https://ndownloader.figshare.com/files/57294051"

文件清单

• isio_a_2547077_sm9436.docx（51.21 KB）
• isio_a_2547077_sm9435.docx（15.76 KB）
• isio_a_2547077_sm9434.docx（32.75 KB）

文件总体积 99.73 KB（源站 API 实测）。

数据说明

To compare the utility of two large language models (LLM) in dry eye disease (DED) clinics and research.
Trained ocular surface experts generated 12 prompts for queries commonly asked by DED patients (n = 10 questions) and research ideas for DED (n = 2). Responses of two LLM models, ChatGPT4 and Perplexity AI, were graded by them using a standardized grading system (1 = needs improvement, 2 = fair, 3 = good, and 4 = excellent) evaluating the response accuracy, compassion, comprehensiveness, professionalism, humanness, and overall quality of each response. The mean scores of the grades from each expert for each response were compared.
The 10 clinical DED prompts received similar overall mean quality grades for the responses with ChatGPT (mean grade score = 2.6) and Perplexity AI (2.7). The mean grade scores for the response characteristics (accuracy, compassion, professionalism, humanness, and succinctness) varied between the experts for each question (range 2.2 to 3.1 for ChatGPT and 2.3 to 3.0 for Perplexity AI). ChatGPT4 generated DED-related research ideas better than Perplexity AI (mean 3.4 vs. 2.6). The source citations for responses by Perplexity AI were from web pages and were not evidence-based. There was slight or poor agreement between the reviewers’ ratings for response characteristics generated by both LLMs.
Perplexity AI and ChatGPT performed similarly for patient-related queries on DED and could have a role in patient education. These LLMs could have a role in DED clinics for patient counseling but require supervision. The LLMs are not ready to generate dry-eye research ideas or perform literature searches for DED.

许可

CC BY 4.0

引用

学术使用请引用 DOI 10.6084/m9.figshare.29944590.v1（source: https://tandf.figshare.com/articles/dataset/Large_Language_Models_Use_in_Dry_Eye_Disease_Perplexity_AI_versus_ChatGPT4/29944590）。