andrew/pfm-ocr
1
0 Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

feat(backend): scan-product accuracy 66.2% -> 79.7% + frozen validation benchmark

Browse Source 
Accuracy work on the 79-image product-scan validation set (user goal: 90%):
- classify_ocr_server.py: 0/90/180/270-degree expiry-date search (stops at
  first hit, 0-degree fallback); classification decoupled onto the upright
  image (rotated frames regressed DINOv2 -6pts until this); cross-line date
  stitching; tiled full-res OCR pass (defeats the 4000px downscale that
  killed small inkjet dates); VL-pipeline expiry fallback with
  keyword-anchored anti-hallucination guard; VL text lines merged into
  text_lines + VL SKU retry. Visualization endpoints removed entirely
  (Visual/Spotting grids - unused by frontend, 3x per-scan GPU cost).
- product-scan.ts: coverage-normalized OCR-evidence re-ranking of DINOv2
  top-K (tuned offline: +8/-0 on top-1 misses), re-ranked class mapped to
  sku_master by SKU prefix; classifier timeout 90s->240s for fallback paths.
- Frozen benchmark: product-test-images-fixed/ (79 renamed images) +
  freeze/seed/build-undetected/capture/experiment scripts; labels trimmed to
  the 79 validation entries (training rows kept in .bak-with-training);
  5 TRAINED-ON SKUs replaced with fresh held-out photos.
- manual-label-scan page: shows last batch-test AI prediction under every
  field by default (new /api/product-scan-results); serves the fixed folder;
  fixed total hydration failure via allowedDevOrigins 127.0.0.1.
- Measured (all-79, zero failures): sku/name 87.3%, expiry 64.6%, overall
  79.7%. Tiles/VL-evidence/VL-SKU deployed but not yet batch-measured.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01Gr6HH7JrdsXX8AARejQboM
This commit is contained in:
Rafhan Mazaya FathurrahmanandClaude Fable 5 committed 2026-07-14 19:55:17 +07:00
1 parent 19f1facf9b
commit e76ccb60a6
156 files changed
+17150 -1405
Download Patch File Download Diff File Expand all files Collapse all files

No files matched your search

backend/sources/sku_master_export.txt
+232
View File
@@ -0,0 +1,232 @@
11140051|AMPELA FROZEN PACK 1 KG(*)
11140062|AMPELA 1 KG FROZEN (20 PAC/KARUNG)(*)
11150052|HATI FROZEN PACK 1 KG(*)
11150055|JANTUNG FROZEN PACK 1 KG(*)
11150064|HATI 1 KG FROZEN (20 PAC/KARUNG)(*)
11150065|JANTUNG 1 KG FROZEN (20 PAC/KARUNG)(*)
11310012|AYAM SIZE 0 (0.6-0.7)KG(*)
11310013|AYAM SIZE1 FROZEN (0.75-0.8) KG(*)
11310014|AYAM SIZE 2 FROZEN (0.8-0.9)KG(*)
11310016|AYAM SIZE Z PR FROZ(*)
11310017|AYAM SIZE 0 PR FROZEN(*)
11310018|AYAM SIZE 1 PR FROZEN(*)
11310019|AYAM SIZE 2 PR FROZEN(*)
11310021|AYAM SIZE BESAR (B) FROZ (1-1.1)KG/PC(*)
11310022|AYAM SIZE A PR (0.9-1)KG/PC(*)
11310024|AYAM SIZE A FROZEN (0.9-1)KG/PC(*)
11310025|AYAM SIZE SUPER (C) FROZ(1.1-1.2)KG/ PC(*)
11310026|AYAM SIZE JUMBO (D) FROZ (1.2- 1.3)KG/PC(*)
11410043|PARTING 10 SIZE D FRESH BENSU 1.25 KG/PAC(*)
11420055|PARTING 12 ALL SIZE FROZ/PAC(*)
11600053|BONELESS LEG FROZEN 1 KG(*)
11620056|SBL (FILLET PAHA) 1 KG(*)
11640053|PAHA UTUH (1 KG)(*)
11650053|PAHA ATAS 1 KG(*)
11660050|PAHA BAWAH (1 KG)(*)
11690053|SBB (FILLET DADA )1 KG(*)
11690081|SBB JUMBO FZ (2.0 - 2.2 KG/PAC)(*)
11710051|DADA UTUH (1 KG)(*)
11720055|FULL WING FROZ PACK 1 KG(*)
11730050|MIDDLE WING FROZ PACK 1 KG(*)
11750050|FILLET MITRA 1 KG(*)
11959937|SATE AYAM FRESHMART 360 GR (PAC)
12010111|FIESTA CRISPY BUBBLE 400 GR/PAC
12010112|FIESTA CHICKEN NUGGET 400 GR/PAC
12010113|FIESTA CHICKEN NUGGET 200 GR/PAC
12010115|FIESTA NUGGET ZOO 400 GR/PAC
12010116|FIESTA NUGGET DINO 400 GR/PAC
12010117|FIESTA NUGGET HAPPY STAR 400 GR/PAC
12010119|FIESTA NUGGET CHEESE 123 400 GR/PAC
12010121|FIESTA NUGGET PIZZABC 400 GR/PAC
12010122|FIESTA CHEESY LOVER 400 GR/PAC
12010123|FIESTA GARLIC CHEESE 400 GR/PAC
12010124|FIESTA CHEESY CHIC W/BROCCOLI 400 GR/PAC
12010127|FIESTA SPICY NUGGET 400 GR/PAC
12010128|FIESTA VOLCANO CHEESE 400 GR/PAC
12010129|FIESTA CHEESY BOMBS CHICKEN NUGGET 400 GR
12010402|GOLDEN FIESTA NUGGET W/PINEAPPLE SAUCE 500 GR
12010509|CHAMP CRUNCHY NUGGET 450 GR/PAC
12010510|CHAMP NUGGET AYAM 225 GR/PAC
12010511|CHAMP NUGGET AYAM 450 GR/PAC
12010512|CHAMP NUGGET AYAM 900 GR/PAC
12010513|CHAMP NUGGET ABC KOMBINASI 225 GR/PAC
12010514|CHAMP NUGGET ABC KOMBINASI 450 GR/PAC
12010515|CHAMP KOIN KOMBINASI 450 GR/PAC
12010516|CHAMP KOIN KOMBINASI 200 GR/PAC
12010517|CHAMP NUGGET STICK 225 GR/PAC
12010518|CHAMP NUGGET STICK 450 GR/PAC
12010519|CHAMP NUGGET STICK 900 GR/PAC
12010521|CHAMP NUGGET HOTZZ LEVEL 5 450 GR/PAC
12010606|CHAMP CRUNCHY NUGGET 225 GR/PAC
12010707|CHAMP MITRA NUGGET COIN 200 GR (NEW)
12010801|OKEY NUGGET 500GR
12012201|ASIMO NUGGET KOMBINASI 500 GR/PAC
12012202|ASIMO NUGGET KOMBINASI 1 KG/PAC
12012203|ASIMO NUGGET KOMBINASI 250 GR/PAC
12012501|AKUMO CHICKEN NAGET 250 GR
12012502|AKUMO CHICKEN NUGGET 500 GR
12012503|AKUMO CHICKEN NUGGET 1000 GR
12012504|AKUMO COIN 200 GR/PAC
12012505|AKUMO KOIN 400 GR/PAC
12020401|GOLDEN FIESTA SP WING 500 GR
12030101|FIESTA STIKIE 400 GR/PAC
12030102|FIESTA STIKIE 200 GR/PAC
12030801|OKEY STICK 1000 GR
12030802|OKEY STICK 500GR
12032201|ASIMO STICK KOMBINASI 500 GR/PAC
12032202|ASIMO STICK KOMBINASI 1000 GR/PAC
12032203|ASIMO STIK KOMBINASI 250 GR/PAC
12032501|AKUMO CHICKEN STICK 250 GR
12032502|AKUMO CHICKEN STIK 500 GR
12032503|AKUMO CHICKEN STICK 1000 GR
12040101|FIESTA SCHNITZEL 400 GR/PAC
12040102|FIESTA CRISPY BUBBLE KATSU 400 GR/PAC
12040404|GOLDEN FIESTA CORDON BLEU BBQ SAUCE 500 GR
12040406|GOLDEN FIESTA KATSU W/CHEESE SAUCE 500 GR/PAC
12050103|FIESTA FRIED CHICKEN 400 GR/PAC
12050104|FIESTA HOT & CRISPY FRIED CHICKEN 400 GR/PAC
12050401|GOLDEN FIESTA CRISPY WING W/SP GLAZ SC 500 GR/PAC
12060103|FIESTA KARAGE 200 GR/PAC
12060104|FIESTA KARAGE 400 GR/PAC
12060105|FIESTA SPICY KARAGE 400 GR/PAC
12060402|GOLDEN FIESTA KARAGE CHILI SAUCE 500GR
12070101|FIESTA POK-POK 400 GR/PAC (NEW)
12080101|FIESTA SPICY CHICK 400 GR/PAC
12130102|FIESTA CRISPY BURGER 360 GR (NEW)
12130504|CHAMP BURGER 315 GR (NEW)
12140105|FIESTA CHICK TOFU 400 GR/PAC
12150201|FIESTA DS CRISPY CRUNCH 300 GR/PAC
12150501|CHAMP CRUNCHY HOTZZ 300 GR/PAC
12190103|FIESTA DELISTRIPE 400 GR/PAC
12240102|FIESTA CHEESY ITALIAN R/BITES 400 GR/PAC
12240103|FIESTA YAKINIKU R/BITES 400 GR/PAC
13010101|FIESTA CHICK SSG 300 GR
13010102|FIESTA CHICK SSG 500 GR
13010111|FIESTA SOSIS BRATWURST 300 GR
13010112|FIESTA CHEESE SSG 300 GR
13010113|FIESTA SOSIS CURRYWURST 300 GR
13010114|FIESTA SSG BOCKWURST 300GR
13010115|FIESTA SSG WIENER 300GR
13010116|FIESTA SSG ORIGINAL 300 GR
13010117|FIESTA SSG FRANKFURTER 300GR
13010118|FIESTA RTG SSG 65 GR/PAC
13010119|FIESTA RTG C/SPICY KOREAN 60 GR/PAC
13010120|FIESTA RTG C/CHEESY MELTS 65 GR/PAC
13010122|FIESTA RTG SAUSAGE WITH HOT LAVA 60G
13010123|FIESTA RTG SAUSAGE WITH CHEESE LAVA 60G
13010124|FIESTA RTG SAUSAGE HICKORY SAUCE 60GR
13010125|FIESTA RTG SAUSAGE WITH MENTAI LAVA 60GR
13010510|CHAMP CHICK SSG 75 GR
13010513|CHAMP CHICK SSG 375 GR
13010514|CHAMP CHICK SSG 1000 GR
13010518|CHAMP SSG JUMBO BAKAR 500 GR/PAC
13010519|CHAMP SSG BAKAR MINI 500 GR/PAC-INACT
13010521|CHAMP CHICK SSG 150 GR/PAC (NEW)
13010523|CHAMP CHICK SSG AYAM MADU 300 GR/PAC
13010524|CHAMP SSG JUMBO BAKAR 500 GR/PAC (NEW)
13010525|CHAMP SSG BAKAR MINI 500 GR/PAC (NEW)
13010809|OKEY CHICK SSG 500GR-INACT
13010816|OKEY SSG BAKAR MINI 500 GR/PAC (NEW)
13010817|OKEY SSG CHICK KOMBINASI 500 GR (EXTRA1)
13010818|OKEY SSG CHICK KOMBINASI 1 KG (EXTR$A2)
13012205|ASIMO SOSIS AYAM KOMBINASI 375 GR (PAC)
13012206|ASIMO SOSIS AYAM KOMBINASI 500 GR
13012207|ASIMO SOSIS AYAM KOMBINASI 750 GR
13012208|ASIMO SOSIS AYAM KOMBINASI 1000 GR
13012209|ASIMO SSG CHICK KOMBINASI 500 GR (EXTRA1)
13012210|ASIMO SSG CHICK KOMBINASI 1 KG (EXTR$A2)
13030101|FIESTA CHICK MEAT BALL 300 GR
13030102|FIESTA CHICK MEATBALL 500 GR
13030501|CHAMP CHICK MEATBALL 200 GR
13030502|CHAMP CHICK MEATBALL 500 GR
11048006|BEBEK PARTING-NEW(*)
13050105|FIESTA CHICKEN SLICE 300 GR
13050106|FIESTA BEEF SLICE 300 GR
13070501|CHAMP BEEF SSG SERBAGUNA 150 GR
13070502|CHAMP BEEF SSG SERBAGUNA 375GR
13070505|CHAMP BEEF SSG GORENG 375 GR
13070506|CHAMP FRANKFURTER SSG 375GR
13100512|CHAMP CHICK SSG S/SANTAP ORIG 546GR (CAN)
13110504|CHAMP BEEF BALL 500GR
13170510|CHAMP BEEF BBQ SSG S/SANTAP 546GR (CAN)
15010101|FIESTA SHOESTRING 500 GR
15010102|FIESTA SHOESTRING 1000 GR
15020101|FIESTA STRAIGHT CUT 500 GR
15020102|FIESTA STRAIGHT CUT 1000 GR
15030101|FIESTA CRINKLE CUT 500 GR
15030102|FIESTA CRINKLE CUT 1000 GR
15040101|FIESTA BATTER COATED 500 GR
15040102|FIESTA BATTER COATED 1000 GR
16060103|FIESTA CHICK SIOMAY 900GR
16060113|FIESTA CHICK SIOMAY 180GR (NEW)
16060114|FIESTA GYOZA 180 GR (NEW)
16060119|FIESTA RTG SIOMAY 54 GR/PAC
16060120|FIESTA KEECHO 400 GR/PAC
16060121|FIESTA CHICKEN TOFU 400 GR/PAC (NEW)
16060503|CHAMP CHICK&FISH SIOMAY 180 GR (NEW)
17200109|FIESTA RTS C/TERIYAKI 300GR/PAC
17200110|FIESTA RTS C/RENDANG 300GR/PAC
17200111|FIESTA RTS C/W RUJAK SC 300GR/PAC
17200112|FIESTA RTS C/W S/MATAH 300GR/PAC
17210106|FIESTA RTS B/YAKINIKU 300GR/PAC
17210107|FIESTA RTS B/RENDANG 300GR/PAC
17210108|FIESTA RTS B/BLACKPEPPER 300GR/PAC
17210109|FIESTA RTS B/BULGOGI 300GR/PAC
18050102|FIESTA RTG BAKSO KEJU 60 GR/PAC
18050103|FIESTA RTG BAKSO BAKAR BBQ 60 GR/PAC
18050104|FIESTA RTG BEEF BALL WITH MENTAI LAVA 55GR
18050105|FIESTA RTG BEEF BALL WITH CHEESE LAVA 55GR
20010101|FIESTA CRISPY CRUMBS 200 GR
20010102|FIESTA TP ROTI PUTIH 200 GR
20040101|FIESTA RAMEN BEKU 570 GR/PAC
20120105|FIESTA T/B SERBAGUNA  80 GR
20120106|FIESTA T/B KREMES 80 GR
20120115|FIESTA RACIK AYAM GORENG 20 GR/PAC
20120116|FIESTA RACIK NASI GORENG 20 GR/PAC
21000123|FIESTA RICE W/GEPREK CHICKEN 320GR/PAC
21000124|FIESTA RICE W/CHICK RUJAK 320 GR/PAC
21000125|FIESTA RICE W/KOREAN BBQ CHICK 320 GR/PAC
21000126|NEW FIESTA CHICK RENDANG W RICE 320GR (PAC)
21000127|NEW FIESTA CHICK TERIYAKI W RICE 320GR (PAC)
21000128|NEW FIESTA CHICK TANDORI W RICE 320GR (PAC)
21000129|NEW FIESTA RICE W KARAGE&SSS 320GR (PAC)
21000130|NEW FIESTA RICE W/C CHEESE BULDAK 320GR (PAC)
21000131|NEW FIESTA RICE W CHIC CURRY 320GR (PAC)
21000132|NEW FIESTA RICE W CHICK DONBURI 320GR (PAC)
21000133|NEW FIESTA RICE W CHICK SATAY 320GR (PAC)
21000134|NEW FIESTA COCONUT RICE W SPICY CHICK 320GR (PAC)
21000135|NEW FIESTA RICE W POPBITES S/MATAH 320GR (PAC)
21000136|NEW FIESTA TUMERIC W POPBITES 320GR (PAC)
21000137|FIESTA HAINAMESE CHICKEN RICE 320GR (PAC)
21010101|FIESTA TRUFFLE GYUDON 320 GR/PAC
21010102|NEW FIESTA BEEF YAKINIKU W RICE 320GR (PAC)
21010103|NEW FIESTA BEEF BULGOGI W RICE 320GR (PAC)
21010104|NEW FIESTA BEEF RENDANG W RICE 320GR (PAC)
21200107|NEW FIESTA SPAGHETTI CARBONARA 300GR (PAC)
21200108|NEW FIESTA SPAGHETTI CHIC BOLOGNESE 320GR (PAC)
21200109|NEW FIESTA ITALIAN MEATBALL SPAGHETTI 320GR (PAC)
21310103|NEW FIESTA SCB&S/SSG FRIED RICE 320GR (PAC)
21500101|FIESTA CHICK SSG & C. BALL PIZZA 230GR/PAC
21500102|FIESTA CHEESY BEEF PIZZA 230GR/PAC
11148002|AMPELA BEBEK FROZEN 1 KG/PACK (NEW)(*)
11318301|BEBEK MUDA-BD1(1.0-1.1 KG)-NEW(*)
11318306|CP DUCK PEKING 1.5-1.6 KG/PC(*)
11318308|BEBEK PEKING SPR BD5(1.7 -1.8 )Kg-NEW(*)
11818300|CP-BEBEK GORENG 400GR/PAC
11110059|CEKER BERKUKU FROZEN PACK 1 KG(*)
11110074|CEKER 1 KG FROZEN (20 PAC/KARUNG)(*)
11840002|AYAM JANTAN BKKL SZ 0 (600-700) GR/PC(*)
12010520|CHAMP CHICKEN NUGGET BENTUK 123 450 GR/PAC
12020102|FIESTA SPICY WING 400 GR/PAC
12030403|GOLDEN FIESTA STIKIE W/ SWEET CHILLI SAUCE 500GR
13010103|FIESTA CHICK SSG 200 GR/PAC
13010815|OKEY SSG BAKAR JUMBO 500 GR/PAC (NEW)
13050101|FIESTA SCB 250 GR
15010107|FIESTA FRENCH F SHOESTRING INSTITUSI 2KG
20120102|FIESTA T/B AYAM GORENG 80 GR
21010105|NEW FIESTA RICE W BEEF BLACKPEPPER 320GR (PAC)
1188002W|PAHA ATAS 25-30 G FZ (*)
1195008A|RTC CHICKEN KALASAN 400 GR (PAC)
1195008E|RTC CHICKEN TERIYAKI 400 GR (PAC)
1195008X|RTC CHICKEN SPICY 400 GR (PAC)
91000012|PHOTOCARD RTG