Apple Silicon Exec Explains Mac Mini AI Demand and On-Device Future

Apple could probably sell a machine starting at $10,000 if they architected it as the sole place one’s Private Cloud Compute [1] ran.

It would need a path to a $2,500 machine, I think. But this is a niche I don’t think another consumer-facing brand could do like Apple.

[1] https://security.apple.com/blog/private-cloud-compute/

If I had the capital I’d make an household inference appliance.

No peripherals except Ethernet, integrated compute (cpu+gpu+mem) and secondary storage (+mobo, psu). No accoutrements, just the minimum amount of hardware to run a model as a utility.

Even the appliance faceplate would be a display showing stats like an old HiFi stereo.

Edit: something like a series of modules consisting of a RISC-V CPU + Vortex GPGPU + memory

It’s not for the AI inference, it’s for the tool calls and desktop GUI app workloads and browser. There aren’t any on-device models capable enough of real work that can run on lower end Mac Minis. But for running a few browsers and GUI apps, you’re much better off buying a Mac Mini than paying for a more expensive and worse-performing container in the cloud. Browsers were not designed to run in Linux containers but they run optimally on baremetal desktop OSes. An M4 Mac Mini beats the single core performance of any VM you might rent in the cloud, in terms of raw compute per dollar (Geekbench scores).

Running models on-device on a Mac is immensely annoying though. Figuring out what will work out of BF16, FP8, BF16+FP8, NVFP4, INT8, GGUF ... the list goes on ... is 'non-obvious' at best. Apple do little to support with tooling. There's MLX, but unless you're happy to transform a model to that format yourself you'll be lagging a long way behind.

Apps like LMStudio, Ollama, Draw Things, etc do a great job of simplifying it but it's still a pain.

This is a paraphrase of https://www.thedeepview.com/articles/how-apple-s-decade-long...

Apple doesn’t have an ads business, and it is inevitable that Google/openai/Anthropic are going to seek to monetise consumer ai via ads.

So the ad free Apple on device experience will be welcome.

Being a Mac switcher since 2003 I am as much of a fanboy as anybody else but this quote from the article caught my attention, and smells like PR.

> Many AI tools are also Mac-first or Mac-only

I fail to recall AI tools Mac-only general purpose AI or agentic tools. Most of the claws, harnesses, studios and inference engines seem to be multiplatform. You can say you can run then in a Mac with a nicer UI wrapper or whatever, but "Mac-first" or "Mac-only"?

I don’t understand why they are not reintroducing the Apple Xserve?

Oh please the neural engine is mostly useless for LLMs. Siri in iOS 27 is laughably pathetic and slow compared to GPT Live DESPITE sending personal context to their (attested) cloud to execute anything but the most basic queries. Still years behind.

> "The speed of AI development right now is just crazy," Brooks said. "I can't imagine where we're going to be a year from now, three months from now, or even a month from now," he added.

I don't think I'm taking this out of context when I say this is unintentionally correct. Apple still doesn't know what to do about AI.

Luckily, it doesn't matter because it's a solution in search of a problem. Most consumers aren't using AI apart from google search.

Everyone else is using it as a content scraper and praying nobody will step in to end the piracy/fraud.

Ok, I didn’t want to take the bait but this one’s just too much.

> “He also described a shift toward running AI locally rather than in the cloud – a move motivated by privacy, security, and the rising cost of inference as agents consume more tokens.”

Classic Apple. No more just beating the “security and privacy” drum, now its “tokens are expensive!”

<neanderthal voice/> Cloud scary. Cloud expensive. Mac good. Buy Mac!

> “He also singled out what he calls ‘transparent AI’ on iPhone and iPad, referring to features scattered throughout the operating system and third-party apps that work quietly without announcing themselves as AI.”

<neanderthal voice/> Apple use AI, Apple just not say it. Apple smart, not lagging behind industry! Buy iPhone!

How about you invest in developing your own models, correctly? And provide a secure and private inference cloud service on your fancy Apple silicon? And integrate that into your platform so Siri gets smarter without you farming queries out to Google Gemini? Bill me for it in iCloud+ I’ll probably pay for those tokens.

Was that so hard?