Confidence Scores for Exam Questions

Discussion (7 Comments)Read Original on HackerNews

vmilner•about 3 hours ago

I seem to remember some medical related multiple choice tests in the UK use a mechanism of +1 for correct , 0 for unanswered , -1 for incorrect.

bArray•about 1 hour ago

Typically you have -1/N for incorrect selection, where N is the number of choices. For N=4, you would grade incorrect answers as -0.25.

If you have a person taking an exam that is not confident in themselves or generally knows the subject area, you don't want to negatively impact educated guessing.

CGMthrowaway•about 2 hours ago

A system like that seems especially appropriate for a practice where the foundational principle is "do no harm."

bee_rider•about 1 hour ago

Would probably be applicable to engineers as well, or any other field where the practitioner has an obligation to be aware of the limits of their competency.

DANmode•about 1 hour ago

and yet.

clickety_clack•about 2 hours ago

It would make more sense to just use IRT for grading the responses than trying to add more complexity to the answers themselves.

esafak•about 3 hours ago

https://en.wikipedia.org/wiki/Calibration_(statistics)

https://en.wikipedia.org/wiki/Scoring_rule

Confidence Scores for Exam Questions

⚡ Community Insights

Discussion (7 Comments)Read Original on HackerNews