Ramp Router

muppetman•about 8 hours ago

I love that 3 years in we're still (Even more so) at the "you have to pick the right model for the job" stage, requiring these sorts of hacks.

If the AI companies were clever they'd offer this themselves.

I find the "We put a model in front of your models so you can pick the right model while you model" mindset to be very strange.

dd8601fn•about 7 hours ago

It feels wasteful, but I do it too. Could definitely be an ignorance problem where I don't really know what the alternative is.

hankbond•about 6 hours ago

Is model routing going to become the next "look at this memory system I made" but for enterprise?

chromatin•about 8 hours ago

Looks like it will be a paid offering? Seems strange coming from a Fintech, unless they're looking to pivot.

handfuloflight•about 8 hours ago

It is not strange at all given their business is spend management and likely a significant portion of their customers spend on inference and would like that spend to be... managed.

riordan•about 8 hours ago

Except as the corporate spending card company they see just how much their customers are spending on inference and have made it a cornerstone of their marketing for the last two years.

Their positioning is: You already have all your teams spending routing through us so that through greater transparency to finance you get better spending controls. We now apply the same to inference, which is spread out across all parts of your company in a similar way.

All summed up really well with their tagline “Tokens are money. Save both.”

Don’t think I’ll be using model routing / shared gateway from Ramp any time soon, but the value of this kind of capability is definitely there. And there’s no shortage of vendors aiming to offer this kind of gateway/router functionality. But most of those come from the technology side of the organization. This gets to come from the office of the CFO.

george88b•about 7 hours ago

Pretty sure it won't be. What makes you think it will be paid?

solatic•about 5 hours ago

> free to use at launch

How does this help me control spend if I don't understand how much it will cost me a year after I bake it into my infrastructure?

Neel49•about 8 hours ago

Honestly it kinda makes sense, Ramp's whole shtick is controlling spend, and this would prolly help people control their AI spend.

Ramp Router

⚡ Community Insights

Discussion (9 Comments)Read Original on HackerNews