Why the Next Era of AI Is About Infrastructure, Not Just Models

Discussion (7 Comments)Read Original on HackerNews

dumbfoundded•2 minutes ago

Will organizations want to control their own proxy or use OpenRouter?

Avalaxy•26 minutes ago

This is why I use databricks. I don't give a damn about which model wins. I use whichever. I can compare them easily in the playground and govern them through unity AI gateway. If one model starts sucking, I swap it out.

_superposition_•43 minutes ago

Agreed with much of this. Models are commodities. LLM gateways are the correct enterprise pattern imo.

verdverm•4 minutes ago

I recently set up GoModel and there's now way I'm going back to a world without it. Gateways are great for local too! I can swap out models or quants and my tools do not need to be reconfigured.

At the enterprise level, you need to be resilient to provoder downtime and gateways can handle this org wide.

dboreham•6 minutes ago

Egads surely Mozilla can produce a blog post that isn't written in AI-speak?

codemog•about 1 hour ago

The CEO has a bunch of AI papers. Seems like a smart guy, but I don’t know why he’s using the Mozilla brand or platform to screw around with AI stuff. Maybe because Mozilla makes no money and they’re hoping to jump on the AI bandwagon? I don’t know, doesn’t seem like it will end well..

Octoth0rpe•39 minutes ago

> Maybe because Mozilla makes no money

Mozilla makes a surprising amount of money, almost entirely from google.

Why the Next Era of AI Is About Infrastructure, Not Just Models

⚡ Community Insights

Discussion (7 Comments)Read Original on HackerNews