Limitation of Feed-Forward Neural Network and CNN :

Issues with Feed-Forward Neural Network:

Feed-Forward Neural Network
  1. Loss of neighborhood information.
  2. More parameters to optimize.
  3. It’s not Translation invariance

Issues with Convolutional Neural Network:

CNN
  1. CNN is a translation invariance but it’s not translation equivariance.
  2. Compared to NN it having fewer parameters to train.

To overcome these limitations we use a capsule network i.e introduce by Geoffrey Hinton.