Projects
Line-break prediction in a small Transformer
I am studying how a small causal Transformer learns to represent line structure, character count, and newline prediction.
Mechanistic interpretability · 2026 · Ongoing
I am studying how a small causal Transformer learns to represent line structure, character count, and newline prediction.