• About Me
  • Blogs
  • Projects

LLM Series Part1: Architecture and Training Stages

Detailed exploration of LLM architectures from Transformer to Mamba, RetNet, and beyond, covering attention mechanisms, MoE, and the complete training pipeline.
Author

Qingsen Zhang

Published

March 20, 2026

 

© 2025 Yuyang Zhang. Built with Quarto.