"Uncensored" open LLMs are measurably more optimistic than their base models

Yeah, original is clearer. Just went with the shorter one so more people would actually click.

Yeah, the optimism/hedging part lines up nicely with that framing. The bit that still puzzles me is that the same edit moved expressed confidence in opposite directions — down for Gemma, up for Qwen. If it were simply removing one shared "anxiety" factor, I’d have expected the sign to stay consistent. So whatever caution is doing here seems a bit more tangled up with each model’s own disposition than a single clean knob.

yeah English isn't my first language so i used AI to clean up the writing. the research, the data and the analysis are all mine and all open (in the linked repo)

> Quick version: “abliteration” (basically removing the direction in the model that causes it to refuse) is the go-to method people use to make open models uncensored.

Tru-ish (lots of people distinguish between abliteration and uncensoring, though.)

> Most people treat it like a clean surgical cut - it just kills the refusals and leaves everything else untouched.

Basically no one does this, its widely recognized that this isn’t how it works and it has for quite some time been common for makers of anliterated model versions to publish metrics for how far a particular abliteration (1) removes refusals (typical before/after refusal rate on a standard test set), and (2) diverges to the output of the base model (KL divergence), and it is widely understood that there is generally, in practice, a tradeoff between these two metrics, where more refusal reduction tends to come at the expense of higher KL divergence.

That’s not saying that it isn’t interesting and new to characterize the kind of divergence that occurs with abliteration in different model families, but there is no reason for a late-night informercial level of misrepresentation of the existing understanding to come along with that.

I vouched for this post, because it's the author's post and certainly contributes to the thread.

I'm sure you're being flagged because you use LLMs to clean up your English grammar. Probably best not to do this here, because HN has a policy against LLM generated posts. There should be some leeway when a non-native speaker is using it for assistance, but there are a lot of people who do not care and will eagerly flag you for it.