TorchTPU: Running PyTorch Natively on TPUs at Google Scale

mmji about 3 hours ago 2 commentsRead Article on developers.googleblog.com

ES version is available. Content is displayed in original English for accuracy.

⚡ Community Insights

Discussion Sentiment

67% Positive

Analyzed from 65 words in the discussion.

Discussion (2 Comments)Read Original on HackerNews

in-silico•28 minutes ago

This is great to see.

I did trained some research models using the existing PyTorch/XLA on TPUs, and it was a mess of undocumented behavior and bugs (silently hanging after 8 hours of training!).

If anyone is trying to use PyTorch on TPU before TorchTPU is released, you can check out the training pipeline that I ended up building to support my research: https://github.com/aklein4/easy-torch-tpu

Reubend•8 minutes ago

Sounds good, but my main question is: is this a fork, or a new backend they're building in (like MPS)?