Skip to content
Daily Epoch
Home
Library
Roadmap
My Library
Sign in
The library
Every paper that built modern AI
Sign in to track your reading →
Start with a course
guided routes for newcomers
New to AI
Zero to Transformers
01
→
02
→
03
→
04
→
05
’86
Backpropagation
’98
LeNet
63 papers in this course →
Vision
How machines learned to see
08
→
09
→
10
→
11
’12
AlexNet
’14
VGG
47 papers in this course →
Generative
Making images, video & sound
12
→
13
→
14
→
15
’14
GANs
’16
DCGAN
35 papers in this course →
Frontier
Reasoning, agents & worlds
06
→
18
→
19
→
16
’22
InstructGPT
’17
RLHF (Christiano)
53 papers in this course →
Free collection
18 landmark papers, free to read
A curated starter collection — the papers that built modern AI, each with a full reading page. Sign up to read them all.
Explore the collection
→
Browse all 21 tracks
All 21
Foundations
Language & LLMs
Vision
Generative
Multimodal & Audio
RL, World & Agents
01
14 guides
Foundations & Training Mechanics
Understand the nuts and bolts that make every model trainable.
1986
Backpropagation
1998
LeNet
2014
Dropout
+11 more →
not started
02
10 guides
Sequence Models & Pre-Transformer NLP
See where modern NLP came from — and why attention was such a leap.
1997
LSTM
2014
GRU (RNN Encoder–Decoder)
2014
Seq2Seq
+7 more →
not started
03
9 guides
The Transformer Family
Understand the architecture behind essentially every modern AI model.
2017
Attention Is All You Need
2019
Transformer-XL
2021
RoPE (RoFormer)
+6 more →
not started
04
10 guides
Encoder / Decoder Language Models
Learn the models that power search, classification and extraction (e.g. BERT/RoBERTa).
2018
BERT
2019
RoBERTa
2019
ALBERT
+7 more →
not started
05
20 guides
GPT Line & Frontier LLMs
Understand how ChatGPT-class models are built and scaled.
2018
GPT-1
2019
GPT-2
2020
GPT-3
+17 more →
not started
06
19 guides
Alignment, Instruction & Reasoning
Learn how a raw model becomes helpful, safe, and able to reason.
2022
InstructGPT
2017
RLHF (Christiano)
2017
PPO
+16 more →
not started
07
17 guides
Scaling, Efficiency & Systems
Make models cheap enough to train and fast enough to ship.
2020
Kaplan Scaling Laws
2022
Chinchilla
2021
Switch Transformer
+14 more →
not started
08
13 guides
CNN Backbones
Understand the workhorses of image recognition.
2012
AlexNet
2014
VGG
2014
GoogLeNet / Inception
+10 more →
not started
09
5 guides
Vision Transformers
See how Transformers took over computer vision.
2020
ViT
2021
Swin Transformer
2021
DeiT
+2 more →
not started
10
16 guides
Object Detection & Segmentation
Build systems that find and outline objects, not just label them.
2015
Faster R-CNN
2017
Mask R-CNN
2016
YOLOv1
+13 more →
not started
11
13 guides
Self-Supervised & Representation Learning
Train powerful models without labeled data.
2020
SimCLR
2019
MoCo
2018
CPC
+10 more →
not started
12
11 guides
Generative — GANs
Understand the models that first made convincing synthetic imagery.
2014
GANs
2016
DCGAN
2017
WGAN
+8 more →
not started
13
5 guides
Generative — VAE & Autoregressive
Learn the probabilistic side of generation behind today's tokenizers.
2013
VAE
2017
VQ-VAE
2019
VQ-VAE-2
+2 more →
not started
14
15 guides
Generative — Diffusion & Flow
Understand the engine behind Midjourney, Stable Diffusion & Sora.
2020
DDPM
2020
DDIM
2021
Diffusion Beats GANs
+12 more →
not started
15
4 guides
3D & Neural Rendering
Explore how AI captures and renders 3D scenes.
2020
NeRF
2022
Instant-NGP
2023
3D Gaussian Splatting
+1 more →
not started
16
14 guides
Multimodal & Vision-Language
Learn how models that see AND read (like GPT-4V) actually work.
2021
CLIP
2023
SigLIP
2021
ALIGN
+11 more →
not started
17
5 guides
Speech & Audio
Understand the models behind voice assistants and transcription.
2022
Whisper
2020
Wav2Vec 2.0
2021
HuBERT
+2 more →
not started
18
10 guides
Reinforcement Learning
Learn how agents master games and control by trial and error.
2013
DQN (Playing Atari)
2016
A3C
2015
DDPG
+7 more →
not started
19
10 guides
World Models & Agents
See the frontier: agents that plan, use tools, and imagine.
2018
World Models
2023
DreamerV3
2024
DINO-WM
+7 more →
not started
20
3 guides
Graph Neural Networks
Learn to model relational data — molecules, networks and knowledge graphs.
2017
GraphSAGE
2018
Graph Attention Networks
2017
GCN
Open track →
not started
21
2 guides
Interpretability & Robustness
Understand why a model predicts what it does — and how it can be fooled.
2017
SHAP
2018
Adversarial Robustness (PGD)
Open track →
not started
Home
Library
Roadmap