Benchmark evidence

Receipts before promises.

Three fixed synthetic artifacts show the useful range and the failure range. They are copied from the benchmark worktree only after their SHA-256 hashes match the source receipts.

No sampled configuration earned automatic publication status.

Highest-scoring synthetic OMR result
F1 0.966

Highest scoring

One exact-measure mismatch remained.

Representative synthetic OMR result
F1 0.675

Representative

Useful practice territory; not publication confidence.

High-confidence synthetic OMR failure
F1 0.052

Failure

Confidence did not track correctness.

Development averages: oemer mean F1 0.663; Audiveris mean F1 0.530 across the 140-page synthetic corpus. These figures characterize that corpus and setup only. Real owner photographs were not used, and no real-photo accuracy claim follows from them.

Attribution

Where these pages came from.

The source pages are from PDMX, licensed CC BY 4.0. Brightclef modified them into synthetic phone-capture inputs, ran optical music-recognition engines, and rendered the recognized MusicXML back to notation for comparison.

Artifact labels, crops, and benchmark overlays are Brightclef modifications. The committed manifest records source commit, hashes, license, and publication status.

What this does not prove

  • It does not measure customer photographs
  • It does not measure audio transcription accuracy
  • It does not guarantee note-perfect import
  • It does support the claim that limitations stay visible
Read the machine manifest