BAND (生物医学警报新闻数据集)

数据集获取

git clone https://github.com/fuzihaofzh/BAND.git

curl -L -o repo.zip https://github.com/fuzihaofzh/BAND/archive/refs/heads/main.zip
unzip repo.zip

源站 README 摘录（使用方式）

Usage

Question Answering

Run Decoder-Only Model

./scripts/train_lm.sh lmrand base

Run Encoder-Decoder Model

./scripts/train_seq2seq.sh band_rand ptm=t5

Event Extraction

Run Encoder-Decoder Model

./scripts/train_outbreak.sh

Run Decoder-only Model

python train_lm.py name "gpt2"

Named Entity Recognition

Run Token-Based NER Model

./scripts/run_token_ner.sh

Run CRF-Based NER Model

./scripts/run_crf_ner.sh

Run Span-Based NER Model

./scripts/run_span_ner.sh

Citation

If you find our dataset or paper useful, please cite our work:

@inproceedings{band2024,
  title={BAND: Biomedical Alert News Dataset},
  author={Fu, Zihao and Zhang, Meiru and Meng, Zaiqiao and Shen, Yannan and Buckeridge, David and Collier, Nigel},
  booktitle={Proceedings of the AAAI Conference on Artificial Intelligence},
  year={2024}
}

数据加载示例（表格/文本类）

import pandas as pd, glob, os

files = (glob.glob(os.path.join(path, "**", "*.csv"), recursive=True)
       + glob.glob(os.path.join(path, "**", "*.tsv"), recursive=True)
       + glob.glob(os.path.join(path, "**", "*.xlsx"), recursive=True))
print("数据文件:", files)
df = pd.read_csv(files[0])
print(df.shape); print(df.columns.tolist()); print(df.head(3))

完整仓库：github.com/fuzihaofzh/BAND