Back to News
Advertisement
Advertisement

⚡ Community Insights

Discussion Sentiment

50% Positive

Analyzed from 86 words in the discussion.

Trending Topics

#harness#testing#test#https#artificialanalysis#common#models#different#harnesses#remember

Discussion (2 Comments)Read Original on HackerNews

eugene3306•about 1 hour ago
What harness do they use for testing?

Back in 2025 it was common to test models in a different harnesses.

I remember watching a guy on youtube, who was testing every new model in opencode, cline, codex, claude, etc.

Why did it come out of fashion ?

EDIT: ah, yeah. the point was that a harness would often affect results (task completion rate, I think) for more than 10%

beklein•24 minutes ago
Details about the methods can be found here: https://artificialanalysis.ai/methodology/intelligence-bench...

Specifically they use this harness: https://github.com/ArtificialAnalysis/Stirrup

threatripper•about 1 hour ago
Can we assume that the test is still private when it was run on many cloud providers?