{"name":"ocr-accuracy","title":"OCR accuracy","keyPoints":["Tie: 3 options, 20 of 20 values read correctly: Landing AI DPT-3 Pro (PDF), Mistral OCR 4.1 + annotation, Sheaf tables (PDF) and 1 other.","No headroom: the best option is right on 20 of 20 values, so these test sets no longer separate quality. Compare time and cost.","A page: $0.035 with Landing AI DPT-3 Pro (PDF), $0.005 with Mistral OCR 4.1 + annotation, Sheaf tables (PDF)."],"tables":[{"heading":"Test set A · CFPB disclosures, forms and tables: 20 values on 2 pages","columns":["Option","Reads","Correct","Wrong","Missing","Time / page","Cost / page"],"rows":[["Landing AI DPT-3 Pro","the PDF","20","0","0","10 s","$0.035"],["Mistral OCR 4.1 + annotation, Sheaf tables","the PDF","20","0","0","10 s","$0.005"],["Reducto r-1","the PDF","20","0","0","6 s","$0.010"]],"note":"Correct: the reading states the value where it belongs. Wrong: it states another value there. Missing: it does not state it. Time and cost: the engine's read of one page."},{"heading":"By page: values read correctly","columns":["Page","Values","Landing AI DPT-3 Pro (PDF)","Mistral OCR 4.1 + annotation, Sheaf tables (PDF)","Reducto r-1 (PDF)"],"rows":[["Test set A · Closing Disclosure, cost details · a digital PDF","10","10","10","10"],["Test set A · Loan Estimate, first page · an image, no text layer","10","10","10","10"]]}],"scoringMethod":"Counted: the values each option's reading states where they belong, on 20 values on 2 pages of 1 published test set, each checked by a person together with the place it is printed. The grader is Claude Opus 5.5, reading the text alone; a model never grades a reading of its own, and a program flags a correct verdict whose value is not in the text.","log":[{"date":"261008","line":"Test set A. Added Mistral OCR 4.1 + annotation, Sheaf tables (PDF): 20 of 20; Landing AI DPT-3 Pro (PDF): 20 of 20."},{"date":"261008","line":"New board. Reducto r-1 (PDF): 20 of 20 values read correctly."}],"updatedAt":"2026-10-08T23:05:19.329Z"}