feat(backend): diff-vs-previous-run reporting for product-scan accuracy harness

Browse Source

Ports the DO-harness's auto-diff-vs-previous-run reporting into
accuracy-check-scan.mts: prints a per-field, per-split (Training/
Validation) delta against the last product_accuracy_history.jsonl entry
and calls out regressions/improvements explicitly, plus classifier
method distribution and average confidence as informational context.

Also adds the real held-out validation photo set into
sources/product-test-images/ (75 photos, one per current SKU class) with
its README documenting the drop-photo -> label -> re-run workflow, so the
harness's Validation Set split actually has images to score against.

Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01Xsxk4ZkDQVVaLUcixDcqb5

...

This commit is contained in:

Rafhan Mazaya FathurrahmanandClaude Sonnet 5 committed 2026-07-14 08:34:02 +07:00

1 parent dc0dd81318

commit 3a17c28758

78 files changed

+306 -55

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

No files matched your search

backend/sources/product-test-images/13010122 FIESTA RTG SAUSAGE WITH HOT LAVA 60G__IMG_2730.jpeg

BIN

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 3.4 MiB