Learning list

This is just a list of resources / readings that I've found while browsing online, and

• Static Polymorphism
• Functors (Function Objects)
• Clarifying References
• Acquire / Release Semantics and Memory Ordering
  • Dave Killian
  • Preshing
  • CUDA memory model

Inference Engine blogs

These are blogs I keep coming back / am subscribed to, as well as some articles that I particularly liked.

• LMSys
  • Int4 QAT RL
• FlashInfer - Better Sampling
• Perplexity's MoE Kernels

• VLLM's blog *
• Hazy Research
  • ThunderKittens 2.0 - Lot of good tidbits and nuances about PTX
• Modular Blackwell GEMM P4 - important for understanding SOTA GEMM
• AI21 Labs blog
  • Decode Cache Bugs in VLLM for Mamba
• Cursor MXFP8 MoE Kernels - great blog that goes into quantization-specific optimizations required for Blackwell. Good for Hopper users porting over to Blackwell.

PTX / NVIDIA notes

• MMA Layouts
• tcgen05 for dummies
• Colfax Intl Blogs
  • FP8 Training
  • Persistent Kernels