Discussion (4 Comments)Read Original on HackerNews

ramon156•about 1 hour ago

Love the idea!

Page is incredibly slow on mobile, probably the avatars

mhi3•about 8 hours ago

"Published benchmarks are gamed, optimized, and overfit, and no longer yield a useful signal."

Is this true?

But I love this concept!

jpschroeder•about 8 hours ago

Oh very true. Benchmaxxing itself is basically gaming them.

memoryleakgame•about 3 hours ago

800 commits in a year...

VibeBench: Measuring 1k Engineers' Opinions of New Models