High Bandwidth Memory (HBM)
3D-stacked DRAM architecture providing massive bandwidth for GPUs and AI accelerators
11 min readConcept
Tagged with
gpu
Explore machine learning concepts related to gpu. Clear explanations and practical insights.
8
Concepts Found
Concepts Related to gpu
GPU Memory Hierarchy & Optimization
Master GPU memory hierarchy from registers to global memory, understand coalescing patterns, bank conflicts, and optimization strategies for maximum performance
8 min readConcept
CUDA Unified Memory
Unified virtual address space enabling seamless CPU-GPU memory sharing with automatic page migration
10 min readConcept
Page Migration & Fault Handling
Understanding virtual memory page migration, fault handling, and TLB management in CPU-GPU systems
9 min readConcept
Understanding CUDA Contexts
Explore the concept of CUDA contexts, their role in managing GPU resources, and how they enable parallel execution across multiple CPU threads.
2 min readConcept
Flash Attention: IO-Aware Exact Attention
Interactive visualization of Flash Attention - the breakthrough algorithm that makes attention memory-efficient through tiling, recomputation, and kernel fusion.
7 min readConcept
Tensor Cores: Accelerating Deep Learning
Understanding NVIDIA's specialized matrix multiplication hardware for AI workloads
6 min readConcept
GPU Streaming Multiprocessor (SM)
Deep dive into the fundamental processing unit of modern GPUs - the Streaming Multiprocessor architecture, execution model, and memory hierarchy
8 min readConcept