OCTCube

OCTCube is a 3D foundation model for optical coherence tomography (OCT) developed by the University of Washington, comprising 26,605 3D OCT volumes (1.62 million 2D OCT images). It is pre-trained using 3D masked autoencoders to capture rich 3D structures, enabling cross-dataset, cross-disease, cross-device, and cross-modality analysis for retinal disease diagnosis and prediction, demonstrating superior performance.

华盛顿大学华盛顿大学
arXiv
2024-08-21 Updated
Views 25
医学影像视网膜疾病医学影像

基本信息

Modality
医学影像
创建/更新时间
2024-08-21

About

OCTCube is a 3D foundation model for optical coherence tomography (OCT) developed by the University of Washington, comprising 26,605 3D OCT volumes (1.62 million 2D OCT images). It is pre-trained using 3D masked autoencoders to capture rich 3D structures, enabling cross-dataset, cross-disease, cross-device, and cross-modality analysis for retinal disease diagnosis and prediction, demonstrating superior performance.

Source Link

http://arxiv.org/abs/2408.11227v1

Visit Source

Official Service

Need support for data access or annotation services? Contact us.

Contact Us

下载信息

注册下载

Tips: 该数据集需要在对应的数据源网站注册通过后,才能进行数据下载,注册有对应要求,或者需要收费。

Unavailable

公开下载

Tips: 该数据集属于公开下载,应该可以免费公开下载。

免登录

有偿下载

Tips: 该数据集 Qianfanghub 可以协助提供有偿下载服务,注意,服务不针对数据相关产权,只是技术服务费。

提供高速下载与技术交付服务(收技术服务费,非数据销售)

Unavailable

千方医数集,医疗数据集部分,是为社区服务的公开医疗数据集搜索引擎,并不存储或者下载原始的任何数据。 如果您有其他医疗数据需求,可以和客服联系,或者下工单。我们有强大的三甲医疗机构帮助您提供个性化的医疗数据定制、采集、标注服务。

使用方式

数据集说明

OCTCube 3D光学相干断层扫描基础模型 对应论文数据集(arXiv 预印本)。

数据获取指引

  1. 打开论文页面获取作者与项目信息:https://arxiv.org/abs/2408.11227v1
  2. 论文 Data Availability / Code Availability 章节标注了数据实际托管位置;
  3. 获取到实际数据链接后,按对应平台标准方式下载。

论文摘要:Abstract:We present OCTCube-M, a 3D OCT-based multi-modal foundation model for jointly analyzing OCT and en face images. OCTCube-M first developed OCTCube, a 3D foundation model pre-trained on 26,685 3D OCT volumes encompassing 1.62 million 2D OCT images. It then exploits a novel multi-modal contrastive learning framework COEP to integrate other retinal imaging modalities, such as fundus autofluorescence and infrared retinal imaging, into OCTCube, efficiently extending it into multi-modal foundation models. OCTCube achieves best performance on predicting 8 retinal diseases, demonstrating strong generalizability on cross-cohort, cross-device and cross-modality prediction. OCTCube can also predict cross-organ nodule malignancy (CT) and low cardiac ejection fraction as well as systemic diseases, such as diabetes and hypertension, revealing its wide applicability beyond retinal diseases. We further develop OCTCube-IR using COEP with 26,685 OCT and IR image pairs. OCTCube-IR can accurately retrieve between OCT and IR images, allowing joint analysis between 3D and 2D retinal imaging modalities. Finally, we trained a tri-modal foundation model OCTCube-EF from 4 million 2D OCT images and 400K en face retinal images. OCTCube-EF attains the best performance on predicting the growth rate of geographic atrophy (GA) across datasets collected from 6 multi-center global trials conducted in 23 countries. This improvement is statistically equivalent to running a clinical trial with more than double the size of the original study. Our analysis based on another retrospective case study reveal

论文页面:https://arxiv.org/abs/2408.11227v1

Accuracy bottleneck? Data gaps?

Current open data not meeting your algorithm needs? We provide high-quality, multimodal real-world clinical data customized for Retinal diseases.

Get Custom Data Solution