Interactive R&D study · Qwen3 attention replay

Font Attention

Language-model attention rendered as a live typewritten page — variable weight, width, slant, optical size, and contextual links held in the ink.

The replay uses pre-recorded Qwen3-0.6B attention tensors, averaged across every head in the final four layers. Playback, scrubbing, speed control, and typeface switching all run locally in the browser without an inference server. Focus, entropy, and self-attention are mapped to typographic weight, spacing, slant, motion, and annotation as an expressive interface—not as a claim about model cognition. The default typewriter case mixes Courier Prime, Special Elite, and Cutive Mono token by token, while a selector can isolate each of those three faces. True Courier Prime italics, synthetic italics for the single-style faces, small caps, and italic small caps add restrained token variants. The foot of the portrait sheet keeps only two controls: typeface and mapping preset, defaulting to Typewriter Mixed Case and Balanced. Attention links use segmented, pressure-varying ink strokes rather than Bézier curves. The strongest attention link uses broken red ballpoint ink; open single-stroke circles, hand-drawn underlines, opaque strikeouts, and unmarked links rotate across related tokens. Circle and strikeout states hold across three token steps, replacing rapid flashes with a calmer revision rhythm. Each incoming token connects directly back to its marked source words, preserving the direction of contextual attention. The same five links are repeated as loose, unboxed handwriting in the page margin, where broad marker strokes encode weight by length without visible numeric percentages. All annotations disappear when the final token arrives. A deterministic print-memory pattern leaves some tokens subtly misregistered or typographically altered after motion settles, while quieter tokens keep the paper-like page coherent.

Model
Qwen3-0.6B
Data
Recorded attention tensors · static JSON
Typography
Three typewriter faces · print memory
Controls
Replay · typeface · mapping