GPUs could explode to multiple TB with new storage-inspired memory tech

jjacquesm about 4 hours ago 3 commentsRead Article on theregister.com

DE version is available. Content is displayed in original English for accuracy.

⚡ Community Insights

Discussion Sentiment

67% Positive

Analyzed from 117 words in the discussion.

Discussion (3 Comments)Read Original on HackerNews

mft_•about 2 hours ago

I’d be okay with only 1.6 TB/s bandwidth in my affordable 512GB GPU. Gotta start somewhere.

Bender•about 3 hours ago

The technology, called high-bandwidth flash (HBF), is being developed by Sandisk and SK Hynix and aims to provide SSD-like capacities at HBM-like speeds.

Persistent storage in a video card? As soon as advertisers can write to this I would expect "bad things to happen"(c). Will the end users have the ability to access and clean this storage like a regular disk prior to any corporations being able to write into it?

jacquesm•about 3 hours ago

Presumably, yes. It essentially boils down to a high capacity flash drive that is just used to store weights with a fast path to the GPU. It's interesting because I had this same idea last week and had been doing some tests and then this Register article rolls around and it is pretty much in the pipeline. Oh well, one day I'll have an original idea.