Back to News
Advertisement
Advertisement

⚡ Community Insights

Discussion Sentiment

100% Positive

Analyzed from 156 words in the discussion.

Trending Topics

#reading#missing#mlx#native#ollama#studio#right#more#locally#model

Discussion (7 Comments)Read Original on HackerNews

y42•about 1 hour ago
good to have a quick overview, though I am missing some kind of depth, like

>There are others — MLX-native runtimes, llama.cpp directly — but Ollama and LM Studio cover 95% of people reading this.

Sure, but... MLX native runtime have a lot of advantages right? and they are not necessarily more complicated like eg ollama. It's worth to mention them, too.

Coming to the next missing part: use cases.

Running it locally competes with dozens of freely available chat bots. And for most simple parts, seriously, you don't need that sophisticated payed AI service. But then: how do local model's perform exactly here: let's start with coding, image generation and more? Like stuff that I probably really want to run locally.

reftel•about 1 hour ago
«The honest table». Right. Not interested in reading what you didn’t write.
b3ing•23 minutes ago
This is old, lm studio support has dropped quite a bit.

As of July the best seemed to be

* nativ

* omlx

* mtplx

reassess_blind•37 minutes ago
Whats the best coding model that fits on 16GB unified memory these days?
fron•44 minutes ago
Entire article is vibeslopped
viggio24•33 minutes ago
clearly AI written (aka "slop"), stopped reading after a few paragraphs
the_real_cher•41 minutes ago
Vibe slop article advertising a product