1. Memory Hierarchy Fundamentals
5 leccionesUnderstand the layers of memory from registers to storage and how proximity to compute affects speed, capacity, and cost.
2. High Bandwidth Memory and 3D Stacking
5 leccionesLearn how vertical integration and wide data paths solve bandwidth constraints in AI accelerators.
3. Profiling Memory Bottlenecks in AI Workloads
5 leccionesUse profiling tools and metrics to identify where memory limits performance in training and inference.
4. Memory Architecture in AI Training
5 leccionesOptimize training pipelines by understanding how batch size, model size, and gradient accumulation interact with memory.
5. Memory Architecture in AI Inference
5 leccionesDesign inference systems that maximize throughput and minimize latency by matching memory to serving patterns.
6. Evaluating AI Accelerator Specifications
4 leccionesRead datasheets critically and compare hardware options based on memory hierarchy, not just FLOPS.
7. Total Cost of Ownership and Infrastructure Decisions
5 leccionesCalculate TCO by factoring memory architecture into power, cooling, utilization, and procurement strategy.
Recibe un correo cuando abra este curso