Georgi Gerganov on llama.cpp/ggml future after Nvidia acquisition of HuggingFace

spindump8930•about 1 hour ago

Folks are concerned that nvidia won't support these efforts if it gets models running on competing hardware. Two responses:

- The projects started without HF/nvidia involvement and were massively successful BECAUSE folks want to run models on their own devices.

- With highly capable agents, "hard to implement" should be less of a barrier. The inference market should in some sense become more efficient, as agents should make it easier to transition between software and hardware solutions. Sure there might be less training data for integration platforms, but if we've learned anything in the past few weeks, it's that agents can be remarkably persistent.

cyanydeez•about 1 hour ago

While true, enshittification should be mourned every time it's renewed until some real kind of block (regulatory changes to the industry) exists.

This is like a company buying your local public pool, and you trying to convince everyone that things won't slowly turn to crap.

monksy•11 minutes ago

Why are we not seeing xcancel alternative links?

X threw a fit.

drum55•1 minute ago

They got a C&D.

qrtas•about 1 hour ago

Translation: Gervanov's ggml.ai was acquired by Huggingface in Feb 2026, so he is now "excited about the journey" after the Huggingface acquisition by Nvidia.

Can we take this as an official statement that Nvidia supports local models?

Why would Nvidia increase GPU efficiency for local models? Surely they'll operate like athletes and only establish a new record from time to time when necessary.

asnelt•3 minutes ago

> Can we take this as an official statement that Nvidia supports local models?

The first reply on the X thread is by Gerardo Delgado, who is "Sr. Director of Product - Local AI, Creators, Developers @NVIDIA" according to his profile. In his post, he says "My team's goal at NVIDIA is to grow Local AI."

credit_guy•about 1 hour ago

Why would they not? The cost to do that is 0.000001% of whatever numbers they usually work with. The upside is that it creates a community of hobbyists, most of whom will us (consummer grade) Nvidia GPUs. Which are not a significant source of revenue for Nvidia anymore, but it’s nice to have a bit of insurance.

kittikitti•41 minutes ago

A company that calls Israel it's "second home" bought HuggingFace. I know how this story is going to end. I regret relying on HuggingFace and llama.cpp because of this acquisition. I'm actively exploring other options before this becomes part of another geopolitical arms race.

Georgi Gerganov on llama.cpp/ggml future after Nvidia acquisition of HuggingFace

⚡ Community Insights

Discussion (6 Comments)Read Original on HackerNews