Ophora-160K

包含16万+眼科手术视频-文本对的数据集,用于文本引导的手术视频生成和流程理解。

上海人工智能实验室, 中国; 上海交通大学, 中国; 蒙纳士大学, 澳大利亚; 华东师范大学, 中国; 温州医科大学附属眼医院, 中国; 上海科学院人工智能科学, 中国; 剑桥大学, 英国; 帝国理工学院, 英国上海人工智能实验室, 中国; 上海交通大学, 中国; 蒙纳士大学, 澳大利亚; 华东师范大学, 中国; 温州医科大学附属眼医院, 中国; 上海科学院人工智能科学, 中国; 剑桥大学, 英国; 帝国理工学院, 英国
arXiv
2025-05-12 更新
浏览 16
多模态眼科手术视频生成
Ophora-160K

基本信息

模态
多模态
大小
0.03 GB
创建/更新时间
2025-05-12
版本
main

资源简介

Ophora-160K

【数据集背景】

本数据集源站标题为《uni-medical/Ophora》。源站首次发布:2025-02-27。

【数据内容】

源站原始描述:# Ophora: A Large-Scale Data-Driven Text-Guided Ophthalmic Surgical Video Generation Model **Abstract:** In ophthalmic surgery, developing an AI system capable of interpreting surgical videos and predicting subsequent operations requires numerous ophthalmic surgical videos with high-quality annotations, which are difficult to collect due to privacy concerns and labor consumption. Text-guided video generation (T2V) emerges as a promising solution to overcome this issue by generating ophthalmic su…

【适用方向】

多模态数据适合跨模态对齐、融合建模与联合表征学习方向的研究。

【获取与许可】

源站页面:https://github.com/uni-medical/Ophora

【使用注意】

· 源站最后修改于 2025-07-16,引用时请注意版本时效。

官方服务

专家保障全链路合规授权与标注交付

陕川双基地 × 超十家三甲医院直连

从合规授权、采集治理、专业标注到数据集交付,我们提供全链路闭环服务,让高质量临床数据即拿即用。

⚡️ 需要原始数据或标注支持?联系我们获取定制方案。

帮我联系

下载信息

注册下载

需要注册 Kaggle 账号并登录后下载,适合需要跟踪下载记录和使用 API 的用户。

暂未开放

公开下载

无需注册即可直接获取公开样本或文档,适合快速预览和评估数据集质量。

免登录

有偿下载

公开数据集受托下载与技术交付服务。

提供高速下载与技术交付服务(收技术服务费,非数据销售)

暂未开放

当前数据集主要来源为 Kaggle 公开托管,完整影像包建议通过原始链接或 Kaggle API 获取。

使用方式

数据集获取

git clone https://github.com/mar-cry/Ophora.git

curl -L -o repo.zip https://github.com/mar-cry/Ophora/archive/refs/heads/main.zip
unzip repo.zip

源站 README 摘录(使用方式)

Ophora: A Large-Scale Data-Driven Text-Guided Ophthalmic Surgical Video Generation Model

Abstract: In ophthalmic surgery, developing an AI system capable of interpreting surgical videos and predicting subsequent operations requires numerous ophthalmic surgical videos with high-quality annotations, which are difficult to collect due to privacy concerns and labor consumption. Text-guided video generation (T2V) emerges as a promising solution to overcome this issue by generating ophthalmic surgical videos based on surgeon instructions. In this paper, we present Ophora, a pioneering model that can generate ophthalmic surgical videos following natural language instructions. To construct Ophora, we first propose a Comprehensive Data Curation pipeline to convert narrative ophthalmic surgical videos into a large-scale, high-quality dataset comprising over 160K video-instruction pairs, Ophora-160K. Then, we propose a Progressive Video-Instruction Tuning scheme to transfer rich spatial-temporal knowledge from a T2V model pre-trained on natural video-text datasets for privacy-preserved ophthalmic surgical video generation based on Ophora-160K. Experiments on video quality evaluation via quantitative analysis and ophthalmologist feedback demonstrate that Ophora can generate realistic and reliable ophthalmic surgical videos based on surgeon instructions. We also validate the capability of Ophora for empowering downstream task of ophthalmic surgical workflow understanding.

Introduction

This repository is for our work submitted to MICCAI25, titled “Ophora: A Large-Scale Data-Driven Text-Guided Ophthalmic Surgical Video Generation Model”.
We have released the training and inference codes of Ophora. The model checkpoint and dataset are released.

Synthesized Videos

Anterio Chamber Flushing Capsule Polishing
Anterio Chamber Flushing: Simulated procedure demonstrating anterior chamber irrigation during ophthalmic surgery. Capsule Polishing: Synthesized video showing delicate capsule polishing with micro-instruments.
Hydrodissection Lens Implantation
:-

数据加载示例(表格/文本类)

import pandas as pd, glob, os

files = (glob.glob(os.path.join(path, "**", "*.csv"), recursive=True)
       + glob.glob(os.path.join(path, "**", "*.tsv"), recursive=True)
       + glob.glob(os.path.join(path, "**", "*.xlsx"), recursive=True))
print("数据文件:", files)
df = pd.read_csv(files[0])
print(df.shape); print(df.columns.tolist()); print(df.head(3))

完整仓库:github.com/mar-cry/Ophora

数据缺失?

依托陕西、四川两大基地,我们与超过十家三甲医院建立直接合作关系,覆盖合规授权、采集治理、专业标注、数据交付的全流程,为AI医疗团队提供即拿即用的高质量临床数据。

⚡️ 需要数据支持或标注服务?立即联系我们获取专业方案。

获取专属数据定制方案