EntitySeg Toolbox: Towards open-world and high-quality image segmentation

EntitySeg is an open source toolbox which towards open-world and high-quality image segmentation. All works related to image segmentation from our group are open-sourced here.

To date, EntitySeg implements the following algorithms:

• Open-World Entity Segmentation (TPAMI2022) --- released
• High Quality Segmentation for Ultra High-resolution Images (CVPR2022) --- released
• CA-SSL: Class-Agnostic Semi-Supervised Learning for Detection and Segmentation (ECCV2022) --- released
• High-Quality Entity Segmentation (ICCV2023 Oral) --- released
• Rethinking Evaluation Metrics of Open-Vocabulary Segmentation (Arxiv) --- released
• AIMS: All-Inclusive Multi-Level Segmentation (NeurlPS2023 Spotlight) -- code to be released
• UniGS: Unified Representation for Image Generation and Segmentation (Arxiv) -- code to be released

Usage

Please refer to the README.md of each project. All projects would be merged to support each other in the soon.

Citing Ours

@article{qi2022open,
  title={Open world entity segmentation},
  author={Qi, Lu and Kuen, Jason and Wang, Yi and Gu, Jiuxiang and Zhao, Hengshuang and Torr, Philip and Lin, Zhe and Jia, Jiaya},
  journal={TPAMI},
  year={2022},
}

@inproceedings{shen2021high,
  title={High Quality Segmentation for Ultra High-resolution Images},
  author={Tiancheng Shen, Yuechen Zhang, Lu Qi, Jason Kuen, Xingyu Xie, Jianlong Wu, Zhe Lin, Jiaya Jia},
  booktitle={CVPR},
  year={2022}
}

@inproceedings{qi2022cassl,
  title={CA-SSL: Class-Agnostic Semi-Supervised Learning for Detection and Segmentation},
  author={Qi, Lu and Kuen, Jason and Lin, Zhe and Gu, Jiuxiang and Rao, Fengyun and Li, Dian and Guo, Weidong and Wen, Zhen and Yang, Ming-Hsuan and Jia, Jiaya},
  booktitle={ECCV},
  year={2022}
}

@inproceedings{qi2022fine,
  title={High-Quality entity segmentation},
  author={Qi, Lu and Kuen, Jason and Shen, Tiancheng and Gu, Jiuxiang and Guo, Weidong and Jia, Jiaya and Lin, Zhe and Yang, Ming-Hsuan},
  booktitle={ICCV},
  year={2023}
}