LLM

As I delved deeper into LLM applications and Agent systems, I became utterly disgusted by the industry’s “AI sycophant” style of mystical marketing. Vendors now constantly boast that their new models “can think” and “have logic,” as if adding a “Pro” or “Thinking” suffix suddenly makes a neural network sprout a human brain. If we don’t adopt an attitude of skepticism and questioning, we can easily be led astray by these attractive claims. Today, let’s coldly dissect the true differences between Flash models and Thinking models, and what those so-called “thinking processes” actually entail, starting from their underlying operational mechanisms and physical limitations. ...

At the time, I used to think that a Decoder was essentially just playing “word-chain” based on the input, unable to pre-determine what it was going to generate as a whole. But looking back now, if we don’t blindly join the hype of those AI sycophants, spouting pretty phrases like “because GPT is more spiritual,” but instead dispassionately dissect it from the foundational layers of Information Theory and engineering reality, you’ll find that the triumph of Decoder-only architectures is, fundamentally, an inevitability dictated by mathematical and physical constraints. ...

「If we’re on the path to the Turing machine, Seq2Seq itself makes more sense than a Decoder." This is a sentence I wrote in my notes in 2022. Back then, I was experimenting with an early version of GPT-2, and I kept wondering: What exactly is this thing? In comparison, models like BART or T5, based on the Seq2Seq concept, seemed much more reasonable. Unexpectedly, a few years later, in this AI arms race, it’s the Decoder-only architecture that has claimed the MVP title. ...

Why I wanted to do this There’s a common misconception about static websites, which is that “static” means dead and unchangeable. But when combined with CI/CD, they can achieve things many people wouldn’t expect. I wanted to do one thing: to automatically update a certain field on this website every week, without me having to manually write anything. My motivations were twofold: The first was purely to test how far static deployments like GitHub Pages can go with automation. From data scraping, calling LLMs, to finally committing to the repo to trigger deployment, the entire chain can be completed within GitHub Actions, without any backend servers. This in itself is very interesting. ...