COUGH

Name: COUGH
Creator: 俄亥俄州立大学

一个用于COVID-19常见问题解答检索的大型挑战性数据集，包含FAQ银行、查询银行和人工标注的相关性集合。

俄亥俄州立大学

arXiv

2021-09-11 更新

文本COVID-19FAQ检索

基本信息

模态

文本

创建/更新时间

2021-09-11

资源简介

COUGH数据集是由俄亥俄州立大学创建的大型挑战性数据集，用于COVID-19常见问题解答（FAQ）检索。数据集包含约16000条来自CDC、WHO等55个可信网站的FAQ项、1236个人工改写的查询以及每个查询对应约32个人工标注的FAQ项，覆盖COVID-19的广泛主题，旨在为FAQ检索模型提供高质量评估基准。

原始链接

https://github.com/sunlab-osu/covid-faq

arXiv 论文 →

访问原始数据

官方服务

如需原始数据获取支持或标注服务，请联系我们。

帮我联系

下载信息

注册下载

Tips: 该数据集需要在对应的数据源网站注册通过后，才能进行数据下载，注册有对应要求，或者需要收费。

暂未开放

公开下载

Tips: 该数据集属于公开下载，应该可以免费公开下载。

免登录

有偿下载

Tips: 该数据集 Qianfanghub 可以协助提供有偿下载服务，注意，服务不针对数据相关产权，只是技术服务费。

提供高速下载与技术交付服务（收技术服务费，非数据销售）

暂未开放

千方医数集，医疗数据集部分，是为社区服务的公开医疗数据集搜索引擎，并不存储或者下载原始的任何数据。如果您有其他医疗数据需求，可以和客服联系，或者下工单。我们有强大的三甲医疗机构帮助您提供个性化的医疗数据定制、采集、标注服务。

使用方式

数据集获取

git clone https://github.com/sunlab-osu/covid-faq.git

curl -L -o repo.zip https://github.com/sunlab-osu/covid-faq/archive/refs/heads/main.zip
unzip repo.zip

源站 README 摘录（使用方式）

COUGH: A Challenge Dataset and Models for COVID-19 FAQ Retrieval

Introduction

This repository contains the dataset for paper “COUGH: A Challenge Dataset and Models for COVID-19 FAQ Retrieval”.
In this work, we present a large challenging dataset, COUGH, for COVID-19 FAQ retrieval. Specifically, similar to a standard FAQ dataset, COUGH consists of three parts: FAQ Bank, User Query Bank and Annotated Relevance Set. FAQ Bank contains ~16K FAQ items scraped from 55 credible websites (e.g., CDC and WHO). For evaluation, we introduce User Query Bank and Annotated Relevance Set, where the former contains 1201 human-paraphrased queries while the latter contains ~32 human-annotated FAQ items for each query.
A list of websites where we collect FAQ items can be found at List_of_websites.txt (Please consult the appendix in our paper for detailed statistics).
Statistics and Comparison of COUGH with representative counterparts:
| | FAQIR | StackFAQ | LocalGov | Sun and Sedoc | Poliak et al. | COUGH (ours)
| :: | :: | :: | :: | :: | :: | :: |
|Domain | Yahoo! | StackExachange | Government | COVID-19 | COVID-19 | COVID-19 |
|# of FAQs | 4313 | 719 | 1786 | 690 | 2115 | 15919 |
|# of Queries (Q) | 1233 | 1249 | 784 | 6495* | 24240* | 1201 |
|# of annotations per Q | 8.22 | Not Applicable | <10 | 5 | 5 | 32.17 |
|Query Length | 7.30 | 13.84 | ** | ** | ** | 12.97 |
|FAQ-query Length | 12.30 | 10.39 | ** | ** | ** | 13.00 |
|FAQ-answer Length | 33.00 | 76.54 | ** | ** | ** | 113.58 |
|Language | English | English | Japanese | English | Multi-lingual | Multi-lingual |
|# of sources | 1 | 1 | 1 | 12 | 34 | 55 |
*: Extracted from existing resources (e.g., COVID-19 Twitter dataset).
**: Not Applicable, as either not in English or not publicly available.
Examples from COUGH dataset are shown below:

License and Terms of Use

This dataset can be used for research and education purpose only. It is shared under the CC BY-NC-SA 4.0 license with attribution to the source websites listed in [```List_of_websites.txt

数据加载示例（表格/文本类）

import pandas as pd, glob, os

files = (glob.glob(os.path.join(path, "**", "*.csv"), recursive=True)
       + glob.glob(os.path.join(path, "**", "*.tsv"), recursive=True)
       + glob.glob(os.path.join(path, "**", "*.xlsx"), recursive=True))
print("数据文件:", files)
df = pd.read_csv(files[0])
print(df.shape); print(df.columns.tolist()); print(df.head(3))