RU version is available. Content is displayed in original English for accuracy.
Advertisement
Advertisement
⚡ Community Insights
Discussion Sentiment
100% Positive
Analyzed from 54 words in the discussion.
Trending Topics
#cheaper#comes#inference#author#here#feel#free#drop#questions#below

Discussion (4 Comments)Read Original on HackerNews
When it comes to inference it should also be cheaper (since we’ve cut attention sequence length by 4x), but I don’t have a hard number for you how much cheaper for inference