Transformers Are Inherently Succinct (2025)

Discussion (6 Comments)Read Original on HackerNews

cadamsdotcom•about 3 hours ago

Seems intuitively sound; a larger model would have the ability to differentiate among a larger variety of concepts, which translates to a larger vocabulary and greater ability to use expressive tools such as imagery, metaphor etc etc.

I could go on, but brevity is virtuous.

pstuart•about 3 hours ago

It makes sense that flowery language is more decorative than functional, but I wonder how much nuance can help shape reckoning, reasoning, and rendering -- if at all.

Maybe RFC terms are all that's needed: https://datatracker.ietf.org/doc/html/rfc2119

Retric•27 minutes ago

Flowery language is a powerful tool, but it demands more from both the reader and writer.

That’s the fundamental flaw in using simple heuristics to evaluate language, the exact same text can be useful or deeply flawed just based on the context. You need to make sacrifices the wider the intended audience.

Transformers Are Inherently Succinct (2025)

⚡ Community Insights

Discussion (6 Comments)Read Original on HackerNews