From be5584b1170f0d965f8a7308b5a3e3055d5eb954 Mon Sep 17 00:00:00 2001 From: Richard Abrich Date: Sun, 23 Aug 2026 09:34:19 -0400 Subject: [PATCH] docs: reconcile the OpenEMR 19/20 correction with older 20/20 summaries Adds a dated oracle-correction note to the OpenEMR benchmark: the stricter saved-row contract rejected compiled run 20 (safe halt at step_017), results.json carries the machine record under oracle_adjudication, and summaries published before 2026-08-22 (flow CHANGELOG entries for the 2026-07 releases, earlier site copy) quote the weaker-oracle 20/20. Links the failed-run bullet to the adjudication record. --- benchmark/openemr/BENCHMARK.md | 13 ++++++++++++- 1 file changed, 12 insertions(+), 1 deletion(-) diff --git a/benchmark/openemr/BENCHMARK.md b/benchmark/openemr/BENCHMARK.md index 477233e5..4859ea3d 100644 --- a/benchmark/openemr/BENCHMARK.md +++ b/benchmark/openemr/BENCHMARK.md @@ -31,11 +31,22 @@ were first committed in `e9897564` after parent `099eac07`; those two SHAs describe artifact history, not the runtime used for the measurement. Not re-measured on a later release. +**Oracle correction, 2026-07-28 — quote 19/20, not 20/20.** The original +whole-frame OCR check scored compiled run 20 a success. The stricter +saved-row contract rejects it: the note stayed in the unsaved form and the +replayer had already halted safely at step_017. The table above reflects +the correction. `results.json` carries the machine record under +`oracle_adjudication`: the exact contract, the retained final frame and +its SHA-256, and the single changed run. Summaries published before +2026-08-22 — including the flow CHANGELOG entries for the 2026-07 +releases and earlier website copy — say 20/20 under the weaker original +oracle. + Failed runs, reported honestly: Compiled arm: -- compiled run 20: saved-row oracle failed; replayer halted at step_017 — The legacy whole-frame OCR verifier matched the note in the unsaved entry textarea. The retained final frame has no saved row for this note. +- compiled run 20: saved-row oracle failed; replayer halted at step_017 — The legacy whole-frame OCR verifier matched the note in the unsaved entry textarea. The retained final frame has no saved row for this note. Machine record: `oracle_adjudication` in [results.json](results.json). Agent arm: