Layer Normalization
Understanding layer normalization technique that normalizes inputs across features, making it ideal for sequence models and transformers.
5 min readConcept
Explore machine learning concepts related to normalization. Clear explanations and practical insights.
Understanding layer normalization technique that normalizes inputs across features, making it ideal for sequence models and transformers.
Understanding the distribution shift problem in deep neural networks that batch normalization solves.
Understanding batch normalization technique that normalizes inputs to accelerate training and improve neural network performance.