LLM Series Part1: Architecture and Training Stages
Detailed exploration of LLM architectures from Transformer to Mamba, RetNet, and beyond, covering attention mechanisms, MoE, and the complete training pipeline.
Qingsen Zhang
March 20, 2026