Skip to content
Proyectos

okunator/cellseg_models.pytorch

Ver en GitHub

okunator/cellseg_models.pytorch has 110 GitHub stars and 5 forks. GitHot measured 0 stars in 24 hours, 0 in 7 days, and 0 in 15 days. Last checked 2026-11-20 02:19 UTC. Last push 2026-11-01.

Cómo se miden estas cifras

What you can do

  • Six model families for cell and nuclei instance segmentation.
  • Pretrained checkpoints available through CSMP Hub.
  • Configurable encoders, decoders and prediction heads.
  • Cell-type classification and optional tissue segmentation alongside instance masks.

Crecimiento de estrellas medido

in 24h
0
in 7 days
0
in 15 days
0
in 1 month
Recopilando historial

Cambios netos en períodos que se solapan, no totales diarios. Los datos no disponibles se dejan en blanco. Las estrellas indican interés, no calidad.

Acerca de

Encoder-Decoder Cell and Nuclei segmentation models

Aprendizaje automático

README.md

Original

Logo

Python library for 2D cell/nuclei instance segmentation models written with PyTorch.

License PyTorch - Version Python - Version Model Checkpoints Tests
Pypi Downloads Codecov DOI

Introduction

cellseg-models.pytorch is a library built upon PyTorch that contains multi-task encoder-decoder architectures along with dedicated post-processing methods for segmenting cell/nuclei instances. See the documentation for installation, user guides and the API reference. As the name might suggest, this library is heavily inspired by segmentation_models.pytorch library for semantic segmentation.

For panoptic segmentation and downstream spatial analysis of whole-slide images, see Histolytics. Histolytics uses cellseg-models.pytorch for its segmentation models.

Features

  • Six model families for cell and nuclei instance segmentation.
  • Pretrained checkpoints available through CSMP Hub.
  • Configurable encoders, decoders and prediction heads.
  • Cell-type classification and optional tissue segmentation alongside instance masks.
  • Inference on individual images, sliding windows and whole-slide images.
  • Datasets, transforms, losses and metrics for training and evaluation.
  • ONNX export for all six model families.

Installation

pip install cellseg-models-pytorch

Install optional features as needed:

pip install "cellseg-models-pytorch[training]"
pip install "cellseg-models-pytorch[onnx]"
pip install "cellseg-models-pytorch[openslide]"

Combine features with commas:

pip install "cellseg-models-pytorch[training,onnx]"

Metrics only

Metrics with NumPy and SciPy, without PyTorch:

pip install cellseg-metrics

Quick Start

Initialize a pre-trained model and run inference

pip install cellseg-models-pytorch
pip install albumentations==2.0.8

This checkpoint expects RGB images with pixel values scaled globally to 0–1.

import numpy as np
from albumentations import Normalize, Resize

from cellseg_models_pytorch.models.cellpose import CellPose
from cellseg_models_pytorch.utils import FileHandler

# Initialize a nuclei segmentation model trained on HGSC data.
# see models in https://huggingface.co/csmp-hub
model = CellPose.from_pretrained(weights="hgsc_v1_efficientnet_b5")

model.set_inference_mode()

# Resize to multiple of 32 of your own choosing
resize = Resize(1024, 1024)
normalize = Normalize(normalization="min_max")

im = FileHandler.read_img(IMG_PATH)
# Match the checkpoint's float32 preprocessing before normalization.
im = resize(image=im)["image"].astype(np.float32, copy=False)
im = normalize(image=im)["image"]

prob = model.predict(im)
out = model.post_process(prob)
# out = {"nuc": [(nuc instances (H, W), nuc types (H, W))], "cyto": None, "tissue": None}

Models

Six model families are available. Find pretrained checkpoints on csmp-hub on Hugging Face.

Model Paper
[1] HoVer-Net https://www.sciencedirect.com/science/article/pii/S1361841519301045?via%3Dihub
[2] Cellpose https://www.nature.com/articles/s41592-020-01018-x
[3] Omnipose https://www.biorxiv.org/content/10.1101/2021.11.03.467199v2
[4] Stardist https://arxiv.org/abs/1806.03535
[5] CellVit-SAM https://arxiv.org/abs/2306.15350
[6] InstanSeg https://arxiv.org/abs/2408.15954

Datasets

Download prepared datasets from CSMP Hub. Each linked dataset card describes its format, labels, splits and license.

Dataset Images Splits License
[7, 8] PanNuke 7,901 fold1, fold2, fold3 CC BY-NC-SA 4.0 (noncommercial)
[9] PanopTILs Refined 1,349 Patient-separated train, val, test CC0 1.0
[10] PUMA 206 Public challenge train CC0 1.0
[11] CytoNuke 83 New patient-separated train, val, test CC BY 4.0 (CPTAC images: CC BY 3.0)
[12] HeLaCytoNuc 2,676 Original train, val (automatic labels), test (manual labels) CC BY 4.0
[13] AIR-LEISH 180 train only; no independent evaluation split CC BY 4.0
[14, 15] Lizard-Mitosis 4,981 Original train, val, test; train/val overlap CC BY-NC-SA 4.0 (noncommercial)
[16] Human Lung 68 Original train (51), val (7), test (10); patient independence unverified CC BY-NC 4.0 (noncommercial)
[17, 18, 19] VitaminP ORION-CRC 3,337 Original case-separated train (2,946), val (272), test (119) CC BY 4.0
[20] Schürch CRC 4,900 Patient-separated train (3,780), test (1,120) CC BY 4.0
[21] Phillips CTCL 7,452 Patient-separated train (5,940), test (1,512) CC BY 4.0
[22] Hoefflin glioma 22,252 Patient-separated train (18,400), test (3,852) CC BY 4.0

Load one PanopTILs Refined sample:

from io import BytesIO

import numpy as np
import pyarrow.parquet as pq
from huggingface_hub import hf_hub_download
from PIL import Image


def read_png(data: bytes) -> np.ndarray:
    """Decode RGB pixels or integer labels without reducing mask bit depth."""
    with Image.open(BytesIO(data)) as image:
        return np.array(image)


path = hf_hub_download(
    repo_id="csmp-hub/panoptils_refined",
    repo_type="dataset",
    filename="train.parquet",
)
row = next(pq.ParquetFile(path).iter_batches(batch_size=1)).to_pylist()[0]
image = read_png(row["image"])
instances = read_png(row["inst"])
cell_types = read_png(row["type"])
tissue_types = read_png(row["sem"])

References

See REFERENCES.md for model papers and dataset sources.

Citation

Please cite the version you used. CITATION.cff provides citation metadata for the software as a whole. The example below cites version 0.1.30.

@misc{lehtonen_cellseg_models_2025,
  doi = {10.5281/zenodo.17608242},
  url = {https://doi.org/10.5281/zenodo.17608242},
  author = {Lehtonen, Oskari},
  title = {{cellseg_models.pytorch}},
  version = {0.1.30},
  publisher = {Zenodo},
  year = {2025}
}

Licence

Original code in this project is licensed under MIT. Adapted third-party code retains its original terms. See third-party notices for sources and bundled license texts, including timm, Diffusers, Kornia, MetaFormer, HoVer-Net, Cellpose, StarDist, scikit-image and HistoPrep. Dataset and pretrained-weight licenses are documented separately in their cards.