My Throw Decides My Aim

uusernotfoundrn about 3 hours ago 2 commentsRead Article on thegustafson.com

DE version is available. Content is displayed in original English for accuracy.

⚡ Community Insights

Discussion Sentiment

100% Positive

Analyzed from 78 words in the discussion.

Discussion (2 Comments)Read Original on HackerNews

argee•about 2 hours ago

Is the model "thinking of the last word for the next line already" or is "the word that came last in the second line was already showing high p from considering only the first line"? Shouldn't we care about such a distinction?

usernotfoundrn•about 1 hour ago

If “aim” is already highly probable after the first line, the example is much less interesting.

A more cool question is whether the model is carrying a latent representation of the destination that isn’t yet reflected in the immediate token probabilities?

I don’t know. Anthropic is investigating: https://www.anthropic.com/research/tracing-thoughts-language...