pool archive signal about

© 2026 unfelixunfelix

archive signal rss api · mcp media kit privacy? keys

0:00 / 5:25

grokking

112 bpm4BA♭ major5:25Oct 24, 2026Δ 5 160 MUF-008.07experiment · generative untrained transformers

from the experiment

generative untrained transformers

attention heads138 bpm · 11B4:38
xavier uniform118 bpm5:25
masked tokens100 bpm4:48
residual stream124 bpm · 12A4:07
exploding gradients86 bpm · 12A3:54
emergent abilities165 bpm · 12B4:40
grokking112 bpm · 4B5:25