ZH version is available. Content is displayed in original English for accuracy.
Advertisement
Advertisement
⚡ Community Insights
Discussion Sentiment
86% Positive
Analyzed from 9094 words in the discussion.
Trending Topics
#memory#mac#more#apple#studio#ram#run#ultra#laptop#desktop
Discussion (319 Comments)Read Original on HackerNews
We make a lot of price/performance compromises for having an attached screen and keyboard on our computer. That was what got me started.
Then I remembered the days of having to go to a special corner of the house to use a computer, vs now when I have a computer with me all the time. In my bag, on the sofa, on the train. Hell, I'm writing this on the work MBP while waiting for an appointment.
And you know what, I think I got more done when I went and sat in a corner of the house all those years ago. I set up an area for "computer work", and it worked really well.
I have a home office, but it's a jumble of cables going into docking stations and all sorts of weird stuff. I think if I streamline it and turn it into a proper "computer room", I might get some of that mojo back. I might even convince my partner that surrendering the home office and having a corner of the den might be good - she can watch TV while I tinker. And I won't be balancing a laptop on my knee and trying to do two things at once.
And the price/performance thing comes back in. Hmm.
And that, from mental load standpoint, is not healthy for most folks.
If your computing needs line up, it's a very serviceable approach.
Never ended up happening. I didn't get much done at home at all and what I did get done was mostly on the couch; not a great environment for serious work. (I have an office where I do for-profit work so it's not an issue, but still, I like my side projects too)
Eventually I had enough decommissioned computer parts that I could assemble them and re-commission them into a working desktop. So I now have a desktop again. And I actually end up sitting at the desk working on stuff on the desktop in a way I rarely did with the laptop.
Screen is small and is only one. Ergonomics is entirely messed up. Either your screen is too low, or your keyboard is too high. Keyboards are non-ergonomic and have to be made with compromises due to height limits. Touchpad instead of mouse/trackball is compromise for many - and also stuck at one position.
And yet they have somehow spread despite number of people going on business trips not really increasing.
It's not like you have to be on a plane for the portability to be useful.
A laptop is a distinct tool from a desktop and if you try to use it like a desktop, I agree it is a terrible substitute. Personally I find laptops vastly more ergonomic than a desktop, but I never program with my feet on the ground.
E.g. what most major tech companies have - a laptop that is for VSCode via ssh/web browsing, and a beefy Linux dev box you ssh into for everything else?
It's way cheaper, and what I use at home too - a lot cheaper than a Mac studio for everything, especially with RAM and storage.
iMacs are great for a lot of use cases, but my image of the typical HN user would prefer to keep the monitor separate.
They gave me a nice MBP for my new job. I tried doing heavy work on it locally, it was fine for that, and yet it still ended up being a light terminal into an EC2 instance, partially because their stuff is on AWS and latency is way lower within that. My personal mini is running too.
I bought a Macbook Air in the interm waiting to see what the Macbook Ultra looks like, but honestly—it's the best form factor ever. I love it! Even though it's only like a pound heavier, the Pro feels like a monster.
Thinking about getting a Mini or Studio with more horsepower to stay at home.
Any other apps or suggestions? I'm still not exactly sure what working this way looks like.
I'm currently SSH-ing into my workstation from my M4 Air with 24 gb ram and it's ideal for this flow. Slack/editors/clients/browsers/etc. easily gobble up over 16 GB. I have no more dev tools/compilers/source on my client machines, everything is dockered up on remote workstation in isolated VMs (too much supply-chaining).
My only downside to using a pro is not having 120/4k HDMI port on air and my dock won't support it with Apple (it does with windows)
I meant the only downside of not using a pro for my use-case is that I don't have a HDMI port on device with high refresh rate. I have a decent dock that can give me 4k/60hz HDMI but not 120hz refresh for macs (it works on windows). It's a minor thing but having 120hz is nice when I'm docked at home.
The issue (apart from my Mac mini still having the old, bigger form factor back then) is that this requires a full shutdown (obviously), and that is more friction than opening a closed laptop lid. It just takes a moment for every app and background service etc. to settle back in after, and depending on how your brain works, you might not like that a whole lot.
It absolutely is a cool feeling to carry a pretty mighty desktop in the backpack, though.
The shutdown thing didn't bother me, and in fact the Mini was lighter than a Macbook Air at the time. So all in all it was pretty convenient.
It will get worse with the MacBook ultra rocking a M5 too.
Apple’s marketing department is gonna kill me.
I want a 2026 pickup truck. The dealer also sells a 2027 hatchback.
I am not shopping for a hatchback.
I’ll be selling my M4 MBA soon, I genuinely use the Neo more. Huge difference in typing experience.
Great repairability is a plus. It was super easy, and actually fun to open. Felt like unboxing an Apple product. Applied the thermal paste mod for $10 which works excellently; I’ve had it shortly after launch.
And I love the notchless display, even if I wished the color gamut was a bit better.
This changes when you get into connotations that aren’t available in the laptop form factor, but with RAM prices the way they are those configurations are more than I want to spend on a local machine right now.
For running local LLMs the high memory Mac options always look appealing, but the processing speed (prefill) is so much slower than GPUs that it hurts. For situations where you have no rush and can let something work in the background for 24 hours it can some times be ignored, but the speeds I get from a real GPU setup are so much faster that I never use the larger models on a high memory Mac any more.
I'm waiting this out.
Having owned 3 MacBook Pros since 2008, the decision to make my next computer be a Mac Studio came down to (1) MacBook thermal throttling that slows down CPUs when it starts to overheat and (2) easier upgrade of Mac Studio SSD with after-market storage module whereas the MacBook requires more complicated disassembly and hot air gun to dislodge the surface mounted SSDs.
I have a brand new M5 Pro MacBook Pro I don't like it when the fans turn on. The Mac Studio will be faster and quieter for the same workloads.
Sorry for not being clearer. I don't like the MacBook's noise when the fans turn on.
The Mac Studio has bigger heat sinks to delay the need for thermal management -- and if its fan does need to turn on, the bigger size means it's still silent instead of the high-pitched whooshing noise the tiny fans make in the MacBook.
Most, if not all, of our current work happens on remote cloud vms. Now I'm stuck with carrying a 3KG monstrosity to work.Every day.
Absolutely no positives compared to my ThinkPad that weighed less than half in my previous job.
Remote development is "good enough" these days. With VS Code, Development containers etc... Having a light weight, portable laptop is so much nicer than a laptop that you can't even rest on your lap for long duration.
The only thing you need to be mindful of using light weight laptops is not having enough RAM to fit all your browser tabs..
Makes managing both backups and handling failure scenarios involving loss or unauthorised access to the laptop less of a hassle as well.
But in the end I ended op buying a Lenovo Legion and put Linux on it.
Laptops are so fast these days that I didn't want to be bothered with setting up connectivity to a remote desktop.
But if your laptop never leaves your desk I think a desktop computer is a great option. Relatively cheaper and easier to maintain and upgrade.
I was using a VM setup on my MBP but it felt like a huge waste, having to leave a laptop on 24/7 when all it did was run Claude Code inside VMs.
I likely will stick with a Macbook Air 15" for next purchase, and beef up my "Claude Server" down the road.
The funniest recurring thing when working at Google was new hires getting baited into taking a Chromebook, then not being able to switch to a Mac for like 2 years. Our team made sure new people didn't fall for that.
Everything is a container or VM now, and none of it runs locally for me.
I have a desktop (older intel) with giant monitors and a keyboard for when I sit at the desk. I have the laptop for when I travel, go out or just want to work from the couch.
When I do my next upgrade to "better hardware" I'm not migrating a machine, rather I'm migrating the containers. My workflow is such that if I loose one of the boxes I sit at to a cup of coffee I really wont care other than the financial loss of a new laptop or keyboard.
The biggest win in all this was dumping the off the shelf firewall/router and moving to Opnsense. Wireguard vpn lets me route all my traffic through home for all my devices (and what is now a growing home lab).
There are scopes of work that this setup would not work for. I would not want to be a video editor with this set up, it's not ideal if you want to play AAA games. But for what I do, it is pretty ideal.
Fir kinda the first time in my life I don’t really have development tools on my personal laptop. I ghostty and openvpn client installed.
I have a large remote linux workstation (2x 8c/16t xeon cpus, 256gb ram, 2x8tb spinning rust disk) and i have my tools over there (along with some VMs).
It works surprisingly well.
Also, the macbook neo is a surprisingly capable little machine.
I personally own an M3 ultra, an M1 max as laptops, but my desktop is a Ryzen desktop I built in 2022 and it was a third in price of the ultra for more power.
I decided to get Mac Studio M4 Max, also all maxed out config and the cooling is so much better that I can run local LLMs like Gemma 3/4, gpt-oss 120b all day long without any heat issues or any audible fan noise. So for my use case it was the right decision. I subsequently added 15'' M5 Max MacBook Pro all maxed out to my collection and even though it is slightly faster on LLM inference (I get 100 tokens/s with Gemma 4 27b model), you just can't run LLMs longer than a few minutes. It starts overheating and gets really loud.
So a combination of a powerful desktop and a "cheap" laptop might indeed be attractive.
There is some consolation there
Staggering?? I can count on no hands the number of times that a fact or figure has caused me to stagger.
Not exactly "future proof" for >1T parameter models but good for targeting specific lower-parameter models, or if you can rely on pipeline parallelism and run a cluster.
- 120v input plug
- not rack-mounted
- has a video out port
Computers are never "future proof".
A 8 years old graphics card can still play modern games. Ten years ago playing a modern game on hardware that old would've been unthinkable.
And with how the market is right now, we'll be stuck on the current "reference level" of hardware for a while longer.
i'm still using an old i7 3770k @ 4.8ghz with 16gb (ddr3) ram running linux for random tasks like executing tests. obviously, power consumption is higher.
my main machine is a MBP M1 Max which i use for everything. i also have my main linux desktop workstation that has a 5950x with 128gb (ddr4) ram.
i'll probably get 2-5 years out of my MBP, and my AMD workstation will probably be good for another 5-10 years.
i'm not a gamer, but i have a 3080. i'm sure my 5950x will still be good for gaming in 10 years if paired with a modern GPU.
It was future proof but not really because it struggled a lot in its final years.
I expect it to stay a mediocre gaming PC for the next 3 years maybe 5 years.
16GB RAM RTX 3060 TI (8 GB VRAM)
Upgradeable components however could go a loooong stretch towards that goal. It can't be that hard to follow a common form factor for at least the housing across two or three generations to allow a reuse of everything but the main PCB.
Would be nice if someone knowledgeable about electrical engineering and manufacturing processes could lay out some valid reasons for manufacturers to integrate RAM onto the motherboard.
https://news.ycombinator.com/item?id=49041256#49082206
But, that doesn't make it a good deal. It just means the Apple tax doesn't apply when stacked up against AI machines and with memory prices being so out of whack. I'm still planning to wait until the RAMpocalypse ends before I buy any more hardware.
A NVIDIA RTX 6000, 96 GB at 1.7 TB/s, is 13 grand.
This 256 GB at 1.2 TB/s Mac is extremely competitive, it will be sold out everywhere.
It feels like PCIe is a bit of a boat anchor here. There's a SATA->NVMe style transition waiting in the wings to make this all so much better. We really need post-PCIe GPUs. CXL with it's very small low latency flits. This is an "almost certainly not" but I wonder if you could mix PCIe and CXL so you could have the GPU memory expose vmeme as a bunch of CXL.mem pools but still have an otherwise pretty normal GPU. It seems madness that UALink went all in on GPU-to-GPU with no affordances for connecting to host computers.
Good for inference; however if you like to train, data format support and effective performance is limited (M5 Pro). Some hardware features are not exposed or extremely slow.
You’ll be fine for inference, but pales in comparison to what a RTX 6000 Pro can do for compute/matmuls/training.
I can run agents using deepseek v4 flash or Qwen 3.8 on my m3 ultra and it will be lukewarm and the fan will eventually start blowing softly.
Wow, "Local AI" mentioned in the subheading above the fold - it's really awesome to see Apple leaning into this use case and I think it will definitely pay off for them going forward. Fingers crossed Apple is able to put some engineering effort towards shipping with one of the frontier open weight models included and optimized exactly for the machine.
I actually wouldn't want a serious model shipping 'on disk'. Models release so often, it's going to get outdated quickly. LMStudio is trivial to set up.
"Storage performance is up to twice as fast, with a next-generation SSD architecture built on PCIe Gen 6..."
This is the first personal computer I've noticed that has PCIe Gen 6 storage. I've only seen enterprise PCIe Gen 6 SSDs up until now. Gen 5 SSDs in consumer devices already have high temperatures and thermal throttling, so I'm worried about how Apple's implementation will perform (I know they don't use off-the-shelf SSDs anymore, but I'd imagine the temps would still be a problem).
[1] https://arxiv.org/abs/2312.11514
Another example as a developer, one particular large project took an hour to build on a spinning disk, on a SSD it takes 2mins
So, yeah, it's really noticable improvement
So while have having this massive almost-symmetric fibre pipe is cool on paper, I haven't felt a huge need to install 2.5G gear all over the house.
data processing, LLMs, model loading, MoE loading, etc, etc relies on very fast storage to keep your GPU saturated.
Basically, Apple gets to cheat because they shove everyone onto the same IC & make the OS that runs on this SOC.
For a non-quantized Deepseek V4 flash on an ultra, I would estimate about 1000+ tokens per second prefill and 50+ tokens per second on generation. This is actually quite usable and near parity to cloud.
They mention "adds the GPU Neural Accelerators." which, if exploitable for LLM loads, would probably help the prefill a lot
I am in Europe, and the Mac Studio M5 Ultra GPU 64 cores with 96GB RAM is up to 6.649,00 €. Ouch.
> A fully configured IBM Personal Computer AT (Model 5170) with expanded memory and storage cost around $5,795 to $6,000 at its launch in August 1984, which equals roughly $18,600 to $19,300 in 2026 USD.
Care to guess the approximate price of the MBP I bought earlier this year?
What is changing is that there genuine demand for more capabilities disproportionate to the cost decrease curve. Fab demand and supply constraints have slowed or even reversed some cost decreases - but that is still getting absorbed by the overall systems costs when you are looking at things like laptops. If you all you want is the last decades demand to browse the web and use office - things are cheaper than ever.
Not that many of us, actually. Only Montana, New Hampshire, Oregon, and some parts of Delaware and Alaska have no sales tax. https://commons.wikimedia.org/wiki/File:Sales_tax_by_county....
It would be significantly cheaper to fly to a tariff-free country and buy there.
Apple also launched the base M6 today with a 32GB RAM limit, suggesting 512GB may remain the maximum for Ultra chips for some time. Since these Ultra chips combine 16 base chips:
32GB × 16 = 512GB
There are no configurations even close to running something comparable to frontier model variants, they're simply far too large, but something like full precision Qwen 35b or DeepSeek 70b at 50+ t/s is well within available configuration, and potential for plenty of room for large context sizes.
I'm using Flash heavily, and I would describe it as nearly as intelligent as Sonnet-class in agentic coding, but more usable. Less world knowledge of course, and definitely a bit less intelligent; but not _that_ much.
On usability: Takes less handholding, less likely to make unsolicited refactors or whatever, and the writing style is readable.
It's not great at super-long-horizon goals as the Claude 5 models are; but if you have a good harness, you can get around that.
We no longer need CD/DVD/floppy drives, storage has shrunk/moved to the cloud. The only thing that's really grown inside a pc case is the video card, and most of these ITX cases are built specifically around fitting popular cards.
Even folks primarily focused on gaming are probably thinking that a full ATX case is a lot of wasted space.
Maybe it's just me, but I think ATX full and mid towers are going the way of the dinosaur.
Isn't 170GB/s slow for bandwidth?
Extremely high bandwidth is great for copying data, but not as relevant for walking chains of pointers, where latency/cache/TLB entries are more important.
So just saying "high bandwidth == better" is true when other variables are the same, but they rarely are, especially in comparison to x86-64 offerings.
All of these are independent that it is a SoC with on-package DRAM.
Compared to something like VRAM it's slow.
Maybe $17k for a 512gig system that can do 1.2TB/s seems like a pretty good deal for a small office.
256GB model is $10k and the 512GB version will probably be double
Seems like miscalculation. If they had their own fab for RAM, they could completely corner the market today.
1.2TB/s memory bandwidth unlocks a lot with 256GB unified, and agentic AI is pretty good at optimising performance.
For comparison, to get 256GB with NVIDIA, you’re looking at a DIY workstation build (need pcie lanes), and like $70k?
The spark’s ~250gb/s bandwidth doesn’t really count here.
The comparison should be against renting in the cloud for the duration of your task for training and research or using pay-per-api-call providers for general inference instead of buying your own hardware (and paying the electricity and cooling bills on top), because let’s face it, the models you want to use are probably the same ones available on inference providers (but, yes, some are more trustworthy than others).
Speaking as someone that does ML/AI research, you are essentially paying a huge premium for being able to just run your Python script at any time without setting up a deployment script and harness to run the job remotely, while your hardware sits essentially idle the rest of the time.
The only way to make the math work is if you rent your hardware in the background for inference while you’re not using it in anger, but despite all the startups and promises that has never become as streamlined as mining bitcoins or shitcoins used to be and they don’t pay out as much as they say they would. Renting your hardware for training is another option but doing that is a lot more involved, options are fewer and farther in between, you won’t get as much utilization out of it, and doesn’t let you feasibly abort running tasks at a moment’s notice.
The maths to me was basically equivalent to prepaying for 242 days of runpod pricing for the same GPU; and I reckon I'd be able to get 6+ years of use out of this card with 96GB.
Plus there's the resell value -- it's actually appreciated by ~50% since I bought it.
Plus I do really enjoy that it's 100% local. I wouldn't feel comfortable giving my agents this much information if inference wasn't 100% local.
I wouldn't get another one, I wouldn't have as much value, but one is definitely paying off for me on the financial side.
1-2$ / hour.
I'm not regretting my setup at home as it got paid by my company which makes sense here, but paying for electricity is quite high and makes already 0.3$/hour alone.
I would argue, the most interesting use case for running it at home is some personal agent which you want to run 24/7.
Only reason to buy this if you want to own your compute.
Experimentation and inference are all going to be cheaper on the cloud
https://www.apple.com/mac-mini/
I may consider a M6 Mac Mini as a stop-gap whilst waiting out RAM Apocalypse to be over. Basically abandoning any ambitions of AI sovereignty and riding out subsidised LLM pricing for the next couple of years.
So not as flexible as apple's unified memory.
Also see: https://apfel.franzai.com
Personally, I can't justify dropping the dosh for a 512GB M5 Ultra, but I would be able to justify it to myself if I could get 1TB of memory, because it'd guarantee the flexibility with local models I currently am missing. Seems a huge miss to not offer this... for a price.
At that point just rent proper GPUs in the cloud, you'd have way more power and pay only what you use for.
I have a bit of paranoia/anxiety about AI, but it's not what most people are concerned with. I understand the limits of these tools very well, and still find them extremely useful. What concerns me is that it's going to become difficult to impossible in the future to run local models which have near-SOTA capabilities in a way in which you can exercise full control of the model. I see the writing on the wall, and its more than worth it for me to invest early to ensure my own capabilities. I am very much not a fan of our "you'll own nothing and be happy" directionality for the world, and I am (at least currently) privileged to have the means to slow that decline for my own self.
I don't actually own a car and my startup is bootstrapped and our salaries are modest. But the one thing we spend on is laptops. I have M4 max pro with 48GB. That thing was on the expensive side (~4.5Kish). But it delivers a lot of value and I spend most hours I'm awake using it. I like fast builds. I like that I can try out open source AI models. And I like just having the option to run those.
We actually lease them and mine costs something like 105 euro/month. Including Apple Care. I don't need a Mac Studio but I could see some roles where that would not be a crazy expense. Even the tricked out version that basically only costs the same as a very modest car.
But +4000$ for an additional 128GB of ram is simply milking the customers, as they know they will have many of them.
I can't hate a direction where Apple becomes more about building great computers rather than trying to force more and more subscriptions. I do wish they would fix many of the long-standing OS and native app problems.
Most people at Apple have already realized that their processors are already too powerful for regular users - heck, as a developer my M2 Pro with 32 GB RAM is more than enough for me.
Regular users don’t care about local AI either. So, they will probably extract as much money as possible during AI gold rush, but then we will most likely see Apple
a. Making their software worse (god forbid, forced updates)
b. Making their hardware impossible to repair (as they almost accomplished this already) and easier to break.
Plus introducing features like RDMA over thunderbolt, which is critical for distributed inference/training/etc. On the software side, Apple is investing heaps.
It's still ridiculous they don't support expandable NVMes, but the memory being soldered makes sense, you need it for 1.2TB/s bandwidth.
They are still selling high-margin hardware. Apple loves selling high-margin hardware.
EDIT: AMD too, it's not limited to Nvidia, nice.
They're eating nvidia's lunch.
I know there's tons of marketing language, buzz words and attempts at convincing me of some agenda that isn't super clear without lots of effort in "validating" the slop. I guess its not bad "slop" though if a human put in effort in editing it (imo >50% human curating = not really bad ai slop)
Though I still would prefer I could just get the prompt. What human thoughts, direction and "prompt" went into writing this article? in the same way as we ask for the prompt for AI generated outputs, I would prefer it for human generated output too. For writing at the least. I could have saved time, got the purity of the argument, and got more clear information. I wonder if we can get a future where humans just express their intent with each other and stop trying to hide our agenda; I want a world we can trust each other greater and interpret and act on our goals without the noise of trying to impress or market to each other & the additional words that go into that.