ArXiv

GigaPath-Flash uses a 22M-parameter ViT-S tile encoder and a 21M-parameter…

Authors
Naoto Usuyama, Jeya Maria Jose Valanarasu, Sicong Yao...
Categories
cs.CV, cs.AI
arXiv
https://arxiv.org/abs/2607.18218v1
PDF
https://arxiv.org/pdf/2607.18218v1

Brief

GigaPath-Flash and GigaTIME-Flash are compact, open-weight pathology foundation models: a 22M-parameter ViT-S tile encoder plus a 21M LongNet slide encoder distilled from a billion-parameter ViT-g. GigaPath-Flash preserves 97% of the larger model's slide-level performance with 50× less compute, while GigaTIME-Flash predicts tumor immune microenvironment from H&E faster (6×) and with 8× lower GPU memory than prior CNN-based GigaTIME.

Why it matters

GigaPath-Flash uses a 22M-parameter ViT-S tile encoder and a 21M-parameter LongNet slide encoder (tile encoder distilled from a billion-parameter GigaPath ViT-g), retaining 97% of GigaPath's average slide-level performance while requiring 50× less compute; models are released under Apache-2.0.

Key details

  • GigaTIME-Flash reuses the GigaPath-Flash backbone to predict the tumor immune microenvironment / spatial proteomics from routine H&E, outperforming the original CNN-based GigaTIME in prediction quality while running 6× faster and using 8× less GPU memory; all models and weights are publicly released.
Source evidence

Abstract

Foundation models have emerged as a driving force in computational pathology, with the potential to transform cancer diagnosis, prognosis, and treatment selection by learning transferable representations from large-scale histopathology data. A growing landscape of pathology foundation models now spans diverse data sources, architectures, and downstream applications. However, most pretrained models operate only at the image-tile level, use restrictive licenses, and remain computationally expensive, limiting large-scale slide-level clinical and research use. Here, we introduce GigaPath-Flash and GigaTIME-Flash, efficient models for whole-slide pathology AI and spatial proteomics prediction. GigaPath-Flash combines a 22M-parameter ViT-S tile encoder with a 21M-parameter LongNet slide encoder, both pretrained on large-scale real-world histopathology data. Its compact tile encoder is distilled from the billion-parameter GigaPath (ViT-g) teacher and shared by both models. GigaPath-Flash retains 97% of GigaPath's average slide-level performance with 50x less compute. GigaTIME-Flash extends this backbone to predict the tumor immune microenvironment directly from routine H&E images. It surpasses the original CNN-based GigaTIME in prediction quality while running 6x faster and using 8x less GPU memory. Together with GigaPath and GigaTIME, these models form an open-weight, Apache-2.0-licensed family pretrained on large-scale real-world clinical data. By releasing all models and weights, we provide accessible building blocks for computational pathology, immuno-oncology, and precision health.

Comment: Models: https://aka.ms/gigapath-flash (GigaPath-Flash) and https://aka.ms/gigatime-flash (GigaTIME-Flash)