Skip to main content

Full course coming soon

AI Accelerator Selection and Infrastructure Design

7 chapters · 32 lessons

  1. 1. Tensor Operations and Hardware Primitives

    4 lessons

    Understand the core tensor computations that dominate AI workloads and how specialized hardware accelerates them.

  2. 2. Precision, Quantization, and Numeric Formats

    4 lessons

    Learn how reduced precision formats increase throughput and when quality tradeoffs are acceptable.

  3. 3. Compiler and Runtime Stack Evaluation

    5 lessons

    Assess how compilers, runtimes, and frameworks translate models into executable plans for accelerators.

  4. 4. Model Serving Architecture for LLM Inference

    5 lessons

    Design serving systems that handle prefill and decode phases efficiently with key value caching.

  5. 5. Accelerator Cost and Performance Benchmarking

    5 lessons

    Build evaluation frameworks to compare accelerators on cost per token, throughput, and latency.

  6. 6. Training Infrastructure and Fine-Tuning Workloads

    4 lessons

    Evaluate accelerators for training foundation models and domain-specific fine-tuning at scale.

  7. 7. Infrastructure Decision Frameworks and Team Readiness

    5 lessons

    Build decision processes that align accelerator choices with team skills, budget, and product roadmaps.

Get an email when this course opens