Awesome Capsule Networks

A curated list of awesome resources related to capsule networks maintained by AI Summary.

Contributing

Please pull a request if you are aware of additional resources.

Your feedback and contributions are always welcome!

Sharing

• Share on Twitter
• Share on Facebook
• Share on Google Plus
• Share on LinkedIn

Table of Contents

• Papers
  • Papers by Geoffrey Hinton and colleagues
  • Under review
  • Preprints
• Videos
• Blogs
• Dynamic routing implementations
  • Official implementation
  • Chainer
  • CNTK
  • Keras
  • Matlab
  • MXNet
  • PyTorch
  • R
  • TensorFlow
  • Torch
• EM routing implementations
  • PyTorch
  • TensorFlow
• Other resources
• License

Papers

Papers by Hinton et al.

• Matrix capsules with EM routing - Hinton, G. E., Sabour, S. and Frosst, N. (2018)
• Dynamic Routing Between Capsules - Sabour, S., Frosst, N. and Hinton, G.E. (2017)
• Transforming Auto-encoders - Hinton, G. E., Krizhevsky, A. and Wang, S. D. (2011)
• A parallel computation that assigns canonical object-based frames of reference. - Hinton, G.E. (1981)
• Shape representation in parallel systems - Hinton, G.E. (1981)
• Optimizing Neural Networks that Generate Images - Tijmen Tieleman's disseration

Other papers

• Multi-level Dense Capsule Networks - S. S. R. Phaye, A. Sikka, A. Dhall and D. R. Bathula (2018)

Under review

• An Optimization View on Dynamic Routing Between Capsules - Wang, D., Liu, E. (2018)
• Spectral Capsule Networks - Bahadori, M. T. (2018)

Preprints

• Capsule Network Performance on Complex Data - Xi, E., Bing, S. and Jin, Y. (2017)
• Accurate reconstruction of image stimuli from human fMRI based on the decoding model with capsule network architecture - Qiao, K., Zhang, C., Wang, L., Yan, B., Chen, J., Zeng, L. and Tong, L. (2018)
• CapsuleGAN: Generative Adversarial Capsule Network - Jaiswal, A., AbdAlmageed, W. and Natarajan, P. (2018)
• Brain Tumor Type Classification via Capsule Networks - Afshar, Parnian., Mohammadi, A., and Plataniotis, K. N. (2018)
• Sentiment Analysis by Capsules - Wang, Y., Sun, A., Han, J., Liu, Y. and Zhu, X. (2018)
• Capsules for Object Segmentation - LaLonde, R. and Bagci, U. (2018)
• Sparse Unsupervised Capsules Generalize Better - Rawlinson, D., Ahmed, A. and Kowadlo, G. (2018)
• VideoCapsuleNet: A Simplified Network for Action Detection - Duarte, K., Rawat, Y.S. and Shah, M. (2018)
• Fast CapsNet for Lung Cancer Screening - Mobiny, A. and Nguyen, H.V. (2018)
• Automated Classification of Apoptosis in Phase Contrast Microscopy Using Capsule Network - Mobiny, A., Lu H., Nguyen, H.V., Roysam, B. and Varadarajan, N. (2019) (code)

Videos

• Geoffrey Hinton's talk: What is wrong with convolutional neural nets? - Talk given at MIT. Brain & Cognitive Sciences - Fall Colloquium Series.
• Capsule Networks (CapsNets) – Tutorial - "This is an amazingly good video. I wish I could explain capsules that well." (Geoffrey Hinton)
• Capsule networks: overview - Overview of Hinton's capsule networks, including vector and matrix capsules.
• Overview of awesome videos

Blogs

• Understanding Hinton’s Capsule Networks - Max Pechyonkin's series
  • Part 1: Intuition
  • Part 2: How Capsules Work
  • Part 3: Dynamic Routing Between Capsules
  • Part 4: CapsNet Architecture
• Uncovering the Intuition behind Capsule Networks and Inverse Graphic - Tanay Kothari's long-form tutorial
• A Visual Representation of Capsule Connections in Dynamic Routing Between Capsules - Mike Ross's diagram
• What is a CapsNet or Capsule Network? - Debarko De's tutorial with commented code
• Capsule Networks Are Shaking up AI — Here’s How to Use Them - Nick Bourdakos's introduction
• Understanding Capsule Networks — AI’s Alluring New Architecture - Nick Bourdakos's deeper explanation about capsules with the visualization tool
• Capsule Networks Explained - Kendrick Tan's explanation
• Understanding Dynamic Routing between Capsules (Capsule Networks): Jonathan Hui's tutorial with commented code
• Matrix capsules with EM routing - Adrian Colyer's post on EM routing
• Cuda, TensorFlow and Capsule Networks - Jos van de Wolfshaar's post on custom TensorFlow Ops with CUDA support for the prediction operation
• Capsule Networks: A Glossary - Sebastian Kwiatkowski's glossary
• Overview of awesome articles

Dynamic routing implementations

Official implementation

• Sarasra/models - The official models used in Dynamic Routing Between Capsules

Chainer

• soskek/dynamic_routing_between_capsules

CNTK

• Southworkscom/CapsNet-CNTK

Keras

• XifengGuo/CapsNet-Keras
• gusgad/capsule-GAN

Matlab

• yechengxi/LightCapsNet

MXNet

• Soonhwan-Kwon/capsnet.mxnet

PyTorch

• gram-ai/capsule-networks
• higgsfield/Capsule-Network-Tutorial
• danielhavir/capsule-network

R

• dfalbel/capsnet

TensorFlow

• naturomics/CapsNet-Tensorflow
• bourdakos1/capsule-networks
• JunYeopLee/capsule-networks
• jaesik817/adv_attack_capsnet
• thibo73800/capsnet-traffic-sign-classifier

Torch

• mrkulk/Unsupervised-Capsule-Network

EM routing implementations

PyTorch

• shzygmyx/Matrix-Capsules-pytorch

TensorFlow

• gyang274/capsulesEM
• www0wwwjs1/Matrix-Capsules-EM-Tensorflow

Other resources

• Capsule Networks discussion - A Facebook discussion group
• loretoparisi/CapsNet - Loreto Parisi's list of capsule network resources
• Will capsule networks replace neural networks? - A question discussed on Quora
• Capsule Networks HW - Homework assignwork in a Python Notebook format
• CapsNet-Tensorflow - CapsNet-Tensorflow's gitter.im group

License

This work is licensed under a Creative Commons Attribution 4.0 International License.