A Mathematical Framework for Transformer Circuits (2021)

BBluestein about 3 hours ago 3 commentsRead Article on transformer-circuits.pub

DE version is available. Content is displayed in original English for accuracy.

⚡ Community Insights

Discussion Sentiment

50% Positive

Analyzed from 54 words in the discussion.

Discussion (3 Comments)Read Original on HackerNews

amelius•about 2 hours ago

> A previous project, the Distill Circuits thread, has attempted to reverse engineer vision models, but so far there hasn’t been a comparable project for transformers or language models.

How successful was that?

Bluestein•about 2 hours ago

The entire thing went down:

- https://distill.pub/2021/distill-hiatus/

... and, here we are.-

myself248•about 2 hours ago

Nothing about B-H curves or magnetization current, must be that other kind of transformer, in that other kind of circuit.