Show HN: TurboGPT: train 22KiB transformer in 13s

llostmsu about 4 hours ago 4 commentsRead Article on github.com

DE version is available. Content is displayed in original English for accuracy.

Inspired by minGPT for home experiments.

Requires CUDA 13.4; build script is Windows only.

Discussion (4 Comments)Read Original on HackerNews

w4yai•29 minutes ago

"hn1g.txt" => not available

vjsrinivas•about 1 hour ago

Interesting trend of labeling models after how big they are on disk vs how many learnable parameters they have.

jey•about 2 hours ago

At that scale it seems like you could just solve the KKT conditions directly. Exaggerating but only a little