The model picker is a dead end

More AI written bloat. why should I bother reading it if you can't bother making it readable? It's like reading a student's essay who had a page of information and is stretching it to fill 5 pages.

This article certainly talks a lot about their brand and their approach. Understandable!

Giving up model selection is giving up some level of control and understanding.

I have no doubts over the long haul what is being said here is true, but I'm confident the tooling to perform model selection will be pushed upstream, not downstream. Model vendors have a strong incentive to produce controllable results and will follow their own benchmarks.

The entire "self-improving" concept is reliant on getting better at getting to a solid result with the right efforts and subagents.

I don’t get how this differs from any other optimization harness. The problem is clear, but I’m not sure on what this company is doing that is unique to solve it.