$20-100+ per comparison set
Nuanced RLHF evaluation requiring domain expertise (one comparison set)
Dated 17 Apr 2026Source checked 14 Oct 2026Quote found on its page again 17 Oct 2026Basis: vendor
In the source's own words
“Simple preference judgments on straightforward queries might cost $2-5 per comparison. Nuanced evaluations requiring domain expertise can run $20-100+ per comparison set.”
Where it was read
Also read from the same source
What it is about
Figures it counts in
- $0.08 per taskWork by people, made to order, per task