Invite testers, and watch their speed and error rates.
Gold error: share of hidden gold frames the person answered differently from the admin's answer (n = gold frames seen). Outvoted: share of their decided frames where the final result went the other way. Above 15% (with at least 5 frames) is red. Look at both before acting: a high outvoted rate alone can mean the others are wrong.
Each job is one bundle of frames from one model.
A frame is final when agree reviewers give the same answer; a split goes to more reviewers, up to max. Agreement is how often a frame's first two reviewers agreed, and π is that corrected for chance (Scott's pi: above 0.6 is good, below 0.4 means the instructions need work). Gold is the share of each reviewer's frames that are hidden gold checks.
Pick a frame.