AI Architecture on datafox.twhttps://datafox.tw/tags/ai-architecture/Recent content in AI Architecture on datafox.twdatafox.twhttps://datafox.tw/images/Open_graph_image.pnghttps://datafox.tw/images/Open_graph_image.pngHugo -- 0.146.0enThu, 14 May 2026 00:00:00 +0000Why Modern LLMs Are Decoder-only: Architectural Evolution and Considerations from Seq2Seq to GPThttps://datafox.tw/posts/260514_1725/Thu, 14 May 2026 00:00:00 +0000https://datafox.tw/posts/260514_1725/When Transformers first emerged, Seq2Seq seemed more logical. However, mainstream LLMs (e.g., GPT) are now exclusively Decoder-only. This article examines the architectural differences between Decoder and Seq2Seq, and their connection to Next Token Prediction, Scaling Laws, and emergent model capabilities.