Tagged with

initialization

Explore machine learning concepts related to initialization. Clear explanations and practical insights.

Concepts Found

Concepts Related to initialization

January 31, 2025

He/Kaiming Initialization

Master He (Kaiming) initialization, the optimal weight initialization technique for ReLU networks that prevents gradient vanishing in deep neural architectures.

deep-learning initialization relu training neural-networks

9 min readConcept

January 31, 2025

Xavier/Glorot Initialization

Understand Xavier (Glorot) initialization, the weight initialization technique that maintains signal variance across layers for stable deep network training.

deep-learning initialization training neural-networks

7 min readConcept