03 · SCORING
Right, complete
and on time.
Quality follows a versioned precision/recall contract. A claim is supported if either reference supports it and contradicted only if both contradict it; recall averages the two references. Speed moves at most a tenth of the reward; before window 30 it moved a fifth (0.8 + 0.2 × time_score).
deadline = min(10 × clip_duration_seconds, 60)
time_score = clamp(1 − elapsed_seconds / deadline, 0, 1)
clip_reward = quality × (0.9 + 0.1 × time_score)
- Averaging
- Clip scores average within each video, and video means average into the evaluation. After three complete videos, one 90% futility check on this fixed batch may stop a challenger early. Its partial score is only an upper bound and never crowns.
- Latency
- Loading and download are excluded from answer time. Every clip has a hard 60 second answer limit, and each attempt has 900 seconds after the shared batch is prepared.
- Zero or defer
- Missing or invalid answers score zero. Infrastructure failures and cancellation at an epoch change defer instead; they never count as zero.
- On chain
- Results are compact chain commitments that followers replay block by block. No HTTP vote counts.