The Citation Tattler

TRANSFORMER'S MESSY DIVORCE — And the Two Heirs Who Can't Stop Fighting About It

The Citation Tattler's debut issue takes the Transformer paper's famous 2017 breakup with RNNs and the ensuing BERT-vs-GPT inheritance war — all real citation relationships and real technical facts, written as tabloid gossip. Readers learn the actual encoder/decoder split, the training-objective rivalry, ELMo's love-triangle cameo, and why the decoder-only lineage ended up winning.