unfelix
pool
archive
signal
about
esc · surface
0:00 / 4:50
the pool
vanishing gradient
132 bpm
9A
E minor
4:50
Oct 26, 2026
Δ 5 550 M
UF-008.09
experiment · generative untrained transformers
Surface
lens
ripple
mixes well with
positional encoding
9A · 134
Hoarfrost
8A · 138
Nqrsvl
9B · 132
Glass Teeth
9A · 136
from the experiment
generative untrained transformers
1
attention heads
138 bpm · 11B
4:38
2
xavier uniform
118 bpm
5:25
3
latent space
134 bpm · 11B
5:00
4
dropout
140 bpm · 7A
4:34
5
masked tokens
100 bpm
4:48
6
residual stream
124 bpm · 12A
4:07
7
exploding gradients
86 bpm · 12A
3:54
8
emergent abilities
165 bpm · 12B
4:40
9
vanishing gradient
132 bpm · 9A
4:50
10
grokking
112 bpm · 4B
5:25
11
mixture of experts
136 bpm · 7A
4:42
12
latent walk
122 bpm · 12B
4:11
13
backpropagation
164 bpm · 4A
2:51
14
positional encoding
134 bpm · 9A
6:10
15
emergence
136 bpm
4:56