Limitation of Feed-Forward Neural Network and CNN :

Issues with Feed-Forward Neural Network:

Feed-Forward Neural Network

1. Loss of neighborhood information.
2. More parameters to optimize.
3. It’s not Translation invariance

Issues with Convolutional Neural Network:

CNN

1. CNN is a translation invariance but it’s not translation equivariance.
2. Compared to NN it having fewer parameters to train.

To overcome these limitations we use a capsule network i.e introduce by Geoffrey Hinton.