Novel Strategy for Weight Initialization in Sigmoidal Feed-forward Artificial Neural Networks
Chaurasia, Rajashree
Novel Strategy for Weight Initialization in Sigmoidal Feed-forward Artificial Neural Networks - Vol 5 (1), Jan- Apr - New Delhi STM Journals 2018 - 62-75p.
paper, a novel method of weight initialization is proposed. The proposed method of weight initialization distributes the initial weights and thresholds in such a manner that they lie in different regions of the activation function used at the hidden layer. The proposed method is compared with six other popular weight initialization methods on ten function approximation problems using the RPROP (Resilient Back-propagation) and Levenberg-Marquardt algorithms for training. Two types of activation functions viz. tan hyperbolic and logarithmic sigmoidal functions are used for analysis and comparison.
Computer Engineering
Novel Strategy for Weight Initialization in Sigmoidal Feed-forward Artificial Neural Networks - Vol 5 (1), Jan- Apr - New Delhi STM Journals 2018 - 62-75p.
paper, a novel method of weight initialization is proposed. The proposed method of weight initialization distributes the initial weights and thresholds in such a manner that they lie in different regions of the activation function used at the hidden layer. The proposed method is compared with six other popular weight initialization methods on ten function approximation problems using the RPROP (Resilient Back-propagation) and Levenberg-Marquardt algorithms for training. Two types of activation functions viz. tan hyperbolic and logarithmic sigmoidal functions are used for analysis and comparison.
Computer Engineering