Is there component correspondence between Reservoirs and Capsules? Do you think an architecture could implement both, either in different complementary modules or in a single integrated module? Could this architecture then be used for NLP tasks?
Maass W., Natschläger T. , and Markram H. (2002). “Real-Time Computing Without Stable States: A New Framework for Neural Computation Based on Perturbations"
Sabour S., Frosst N., Hinton, G.E., (2017). "Dynamic Routing Between Capsules"
Both Reservoir Computing and Capsule Networks admit graph-based models. Differences mainly rely on graph topology and learning dynamics.
Follow:
- Li et al., "A Capsule-unified Framewok of Deep Neural Networks for Graphical Programming", 2019 - https://arxiv.org/pdf/1903.04982.pdf
- Verma et al., "Graph Capsule Convolutional Neural Networks", 2018 - https://arxiv.org/pdf/1805.08090.pdf
- Lenssen et al., "Group Equivariant Capsule Networks", 2018 - https://papers.nips.cc/paper/8100-group-equivariant-capsule-networks.pdf
- T. Fardet, "Influence of network topology in reservoir computing", MSc, 2015 - http://www.ens-lyon.fr/DSM/SDMsite/M2/stages_M2/Fardet2015.pdf
- Ganguli et al., "Reservoir Computing based Neural Image Filters", 2018 -
Preprint Reservoir Computing based Neural Image Filters
About architecture design and implementation, refer to the following related question on RG: https://www.researchgate.net/post/Which_is_the_universal_neural_network_implementation_like_feed_forward_CNN_Or_RNN_which_can_be_used_in_any_problem_domain
To clarify the relationships between ANNs and Reservoir Computing/Capsule Networks, you may have a look at:
- Lukosevicius et al., " Reservoir Computing Approaches to Recurrent Neural Network Training ", 2010 - http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.709.3657&rep=rep1&type=pdf
- N. Kuppuswamy " From Neural Networks To Reservoir Computing ", 2013 - https://www.ifi.uzh.ch/dam/jcr:00000000-7f84-9c3b-ffff-ffffbda0da2e/zurich_26_04_13.pdf
- Sabour et al., " Dynamic Routing Between Capsules ", 2017 - https://arxiv.org/pdf/1710.09829.pdf
Related question of interest on RG: https://www.researchgate.net/post/what_is_the_realitionship_between_deep_learning_methods_and_reservoir_computing_if_any
- Badges
- Science topic
- Similar topics
- Linguistics
- Composition Studies
- Publication