Weights in Deep Neural Network don't change while bias change a lot. Why?
Here is the result from tensorboard. hyperlinks.
As we saw, the loss has decreased and the Accuracy (both train and test) has increased. Hence, the model has already been trained successfully.
However, Distribution of parameters, weights/bias doesn't change (might change little), while the bias change a lot.
Could someone help me to explain what causes this ?
I knew this is normal result but why?
Thank you!
Edition: Could someone share the experience of training Deep Neural network?
what will be the real expectation of changing for parameters in successful trained model?
Thank you.
By clicking "Post Your Answer", you acknowledge that you have read our updated terms of service, privacy policy and cookie policy, and that your continued use of the website is subject to these policies.
