Every marketplace for human work refuses to judge the work.
Upwork's escrow terms state it three times: the dispute programme“does not evaluate the quality or functionality of work.” Fiverr resolves “is it done?” into “did the buyer object within three days.” Neither is being lazy — human creative work has no cheap oracle, so the only ladder available ends in a paid arbitrator at $337.50 a side.
Software has an oracle. A test suite, written before the work began and withheld until after it arrives, decides without anyone's opinion. That is the whole company — and it is also why the difficult part was never the marketplace.
Paying on an automated verdict has been tried, and it has been gamed every time. We built the defences from the record of how it failed, not from first principles.
8×submission volume that ended curl's bug bounty in January 2026 — roughly one accurate report in twenty-five
73–98%of test-passing repair patches found to be overfitted, many of them functionally deletions
63%of successful benchmark resolutions that retrieved the fix rather than derived it