New to neural networks? There's a short ELI5 in the comments.
I created this as an updated take on the Neural Network Zoo, which I've long appreciated as a one-page reference. The Zoo is from 2016 (with a small 2019 update), so it stops before most of what came after: BERT and GPT-style LLMs, diffusion models, ViT, Mamba, mixture of experts. Like the Zoo, this mixes architectures (how a network is wired, like a CNN or Transformer) with training schemes (how it learns, like a GAN or diffusion). That's on purpose: you hear these names side by side as kinds of neural networks, so a reference for looking them up should cover both.
My hope is that it can serve as a quick (and cool!) reference guide.
- Interactive version: a short explainer for each architecture, its training objective, and links to the original papers. Free printable PDF and PNG posters are there too.
- Code: each diagram is a few lines of YAML drawn by a Python script, so it's easy to fix or extend.
An earlier version was removed from r/dataisbeautiful for not being a data visualization (fair enough). Comments there shaped a number of changes in this one.
Anything wrong or misleading, or anything important missing? Corrections are very welcome, here or as GitHub issues.