Open Internet by MindsNet

Understanding and Addressing Shattered Gradients in Deep Neural Networks

Deep neural networks sometimes perform poorly as they get deeper, not due to overfitting, but potentially due to shattered gradients. This issue causes the gradients to become less meaningful, hindering the training process. The concept of shattered gradients needs clearer understanding and effective solutions.

Computing & Technology, Computer Science, Machine Learning