Advertisement
Advertisement
⚡ Community Insights
Discussion Sentiment
60% Positive
Analyzed from 1965 words in the discussion.
Trending Topics
#need#reasoning#gpt#models#thoughts#cot#qwen#paper#let#model
Discussion Sentiment
Analyzed from 1965 words in the discussion.
Trending Topics
Discussion (57 Comments)Read Original on HackerNews
If I got it correct (appending B from https://stolen-thoughts.com/paper.pdf is essential) they are the authors of the well-known exploit to recover readable CoT from OpenAI and Anthropic models. They use that to find hints of distillation, by running a benchmark with a SotA model, recovering the CoT, then taking the first 1% of the CoT and running the open-source model as if that was the start of its own CoT. In the paper they found that Kimi-K3 gets a lot closer to Claude 4.8 answers when prefilled with the start of Claude 4.8 reasoning, suggesting that Claude 4.8 was used in its post-training. This blog post is the follow-up with results that suggest that Qwen3.8 was post-trained with the help of GPT-5.5 Pro (or some similarly responding GPT model, it's unclear how many models they tested)
But for the question studied here it probably doesn't matter - overlaps in the publicly available output may be indicative of distillation (or not), regardless of what it is. I would just find it surprising that the Chinese labs would use it so trustingly. The publicly released reasoning trace is the first place where I would suspect some distillation poisoning to be injected.
https://stolen-thoughts.com/paper.pdf
Qwen 3.8 0902 was trained after the release of the paper on August 10, so it should have seen those specific thoughts.
I "independently" "invented" it for the first Anthropic reasoning models because the API required you have thoughts for each assistant message. My app lets you switch AIs within a chat, and their API used to require thinking for all messages if thinking was enabled, so I needed to get a valid thinking stub to insert.
Time has flew by for me the last 3 years, but, I'd guess it's been at least 18 months. And IMHO it wasn't very complicated to work through how to do once you were dead set on making it happen. I expect it was well-known to distillers before the paper.
My point is that any model trained after August 10 will know of those specific thoughts.
I see some details about recovering information via whatever technique. It's interesting, but appears not generalized.
So for a specific question, yes, but this is not about techniques like adding a good embedding that just generally tends to improve open model performance on certain tasks.
Nevertheless, this was the first time I'd seen Sol's CoT. I looked up the stolen thought's paper, aaaaand yep, that's Sol's CoT alright.
But it occurred to me, hey, Qwen3.8 27B's CoT seems ... very similar.
I compared the geometry problem in the paper, which had a reasoning block open with:
I passed the same prompt to Qwen, which opened with: This proves nothing, but it does seem an awful lot like they did use GTP-5.5/6 reasoning traces...But when I give short prompts to Qwen3.8 with no system prompt or previous instructions, it seems to strongly gravitate towards grug-talk.
“Write a complete short story scene of 2000-3000 words. Use a third-person limited perspective focused on a character named Rowan. The scene must include the following plot elements: a raccoon, Milo returns, a storm power failure, an elderly customer knocks, and a thermos somewhere. Make sure the scene ends feeling finished. Output only the story; do not include any outline, preamble, analysis, or meta-commentary.”
And here's Qwen's thinking trace:
> The user is asking for a short story scene of 2000–3000 words. Third-person limited POV, Rowan. Plot elements: a raccoon, Milo returns, a storm causing a power outage, an elderly customer knocks on the door, a thermos. End with a sense of closure. Output only the story.
> Let me plan carefully. I need to count words in my head—roughly 2400–2600 words would be safely in range. Let me draft.
> Setting: a small-town shop or a gas station/diner where Rowan works the night shift. Milo returns—Milo is probably Rowan's partner, brother, or ex. Let me make Milo Rowan's brother who's been away (military? a road trip? rehab?). Better: Milo is the younger brother who disappeared/went away after a fight. He comes back in the middle of a storm.
While at the very beginning it rephrases the prompt in very short sentence, it's nowhere near close to the above GPT thinking trace and it quickly moves to plain sentences.
What? I've never seen garbled CoT like the one you posted when using Qwen3.8-27B.
If Qwen and other Chinese labs are just copying reasoning traces, then those labs are more than a year behind the frontier.
Even if they weren't political adversaries of freedom, I would still feel 0% bad given all their training is already on data they got for free.
Information continues to want to be free. To the benefit of us all.
If I may propose instead of "steal" I think we could agree to write they "Aaron-Swartz'ed" the information from the internet, what do you think, is this too harsh on Sam Altman or Carmen Ortiz ?
How does this suggest anyting of the sorts?
Score go up. Probability go up. Conclusion.
(slibhb: Don't get me wrong, I agree with you 99%. But the frontier labs have zero moral authority here.)
I look forward to a day when open models are so dominant that we stop considering traces to be some form of intellectual property that must be hidden from / manipulated for paying users.
It's that manipulation of inputs and outputs that really rubs me the wrong way
this what is permissible for Jupiter is not permissible for a cow bullshit alone should tell people all they need to know about what kind of greasy sociopaths run "open"ai and (mis)anthropic, and how seriously you should take their purported stances on "safety" and other self-serving shit.