The test
Find the clause. Quote it exactly.
Each model read commercial contracts and had to find 10 kinds of clause, quoting the exact text. Lawyers had already marked the right answers. None of the 102 test contracts were used in training.
Accuracy here means how often the model quotes exactly the right text. 1.0 is perfect.