42
aandrewstetsenko about 4 hours ago 0 comments
FR version is available. Content is displayed in original English for accuracy.
FR version is available. Content is displayed in original English for accuracy.
Discussion Sentiment
Analyzed from 371 words in the discussion.
Trending Topics
Discussion (0 Comments)Read Original on HackerNews
Local LLMs are awesome. Hopefully the way things go, in a few years everyone will have a local LLM that works for them, rather the bigcorp that made it. But it feels like cope to assert that cloud LLMs are dead.
Right now, the cloud-LLMs have big and IMO growing advantages. Cloud-LLMs are better at utilizing GPUs, economies of scale drive their serving cost down, they have the advantage in ability to monetize (like SaaS has the advantage over desktop apps), and they'll always have the most capable models. The question is whether the advantages of local LLMs in terms of personalization and data soveignity is worth it to consumers. And we saw what choice consumers made last time around, choosing centralized SaaS companies rather than a more distributed web.
Interesting how apple, the company without any stack in ai/llm get to decide where things are going.
LLM is useful only when it's run on a data center consuming all water in a drought hit area and constantly buzzing residents near it, anything short of that is meh. Similar to blood diamond vs synthetic one