Mercury 3
Forty times the scale without the slowdown is the kind of claim that makes me want to see the benchmark methodology. Diffusion models have been knocking around language for a while, mostly as a curiosity next to the dominant autoregressive approach. If Mercury 3 actually holds up, it suggests the compute budget doesn't have to balloon with model size the way we've come to expect.
What I'd want to know next is how they measure slowdown and what the quality curve looks like at that scale. A 40x jump that keeps latency flat is one thing, but if the outputs degrade or the training cost explodes, the story gets more complicated. The interesting part is that it points to a different trade-off space, where you can chase scale without constantly fighting the clock on inference. That would matter for anyone running LLMs in production.
I'm cautiously optimistic, but I'd want to see independent replication before getting too excited. The field has seen plenty of efficiency claims that looked great on paper.
