Python optimize [Multi-coop multi-floor discovery, Auto .engine compilation, API, mortality webapp trigger, parallel processing/tensor batching/hybrid, etc.] #3

2026-08-20T10:58:13+07:00

andrew commented

2026-08-20 10:58:13 +07:00

too many stuff to mention

andrew added 39 commits 2026-08-20 10:58:21 +07:00

Try to make it work in Jetson Orin Nano 7aa5d5eb61

Add RUN.md e2405b1cab

Merge pull request 'Optimize python biar bisa jalan di Jetson Orin Nano' (#1 ) from dsutanto/chicken-counting-sukawarna-det:main into main 69751c9c1d

Reviewed-on: #1

Update with requirements.txt 6af7dc1de0

merge upstream 1a3242f611

Fix WARNING and CC2 not writing json to ouput folder af4e514357

Remove shared tracker between cameras, fix task warning, add export script d31ad05f0a

- Remove shared DetectionTracker across cameras to prevent state leakage
- Add task="detect" to YOLO constructor to suppress warning
- Add export_engine.py script for .pt to .engine conversion
- Regenerate ONNX and TensorRT engine with latest settings

Optimize counting.py: fast-reject, skip empty tracks, throttle purge a54d0e6b2c

- Return early when tracks list is empty
- Fast-reject centroid by bounding rect before pointPolygonTest
- Purge stale tracks every 30 frames instead of every frame
- Skip deque append when trail_length == 0

Dashboard: auto-focus running camera, show date + all-camera totals 6dbaa517dc

- Auto-detect active camera by polling frame_index
- Show All Cameras Total accumulation in sidebar
- Show per-camera totals in camera list
- Add run_date to stats.json and display in dashboard
- Pipeline: thread run_date through build/run/batch

DB: write incrementally after each camera, Flask dashboard with single-camera view efd4726bc6

- batch_runner: _store_to_db after each camera (not just at end)
- dashboard: Flask app with templates/index.html
- Single-camera full-screen live stream with auto-switch
- DB history panel in sidebar
- store_results.py: standalone script for existing reports

Add DB API endpoints: summary, history, date, camera, location ae86821165

- api/db/summary — overall totals
- api/db/history — per-date rows
- api/db/date/<date> — single date detail with per-camera breakdown
- api/db/camera/<id> — all runs for a specific camera
- api/db/location/<name> — per-location summary + history
- API.md — full endpoint documentation with schema

Clean all /dev/shm counters on batch start 9512fc7f4d

Wipe chicken_counter_* directories on batch start so dashboard
starts clean and populates as each camera runs.

Reduce dashboard CPU: cache DB, suppress logs, add systemd service dc447264b7

- Suppress Flask request logs (werkzeug ERROR only)
- Cache SQLite connection with WAL + 8MB cache
- Increase poll_ms 500->1000, history refresh 30s->60s
- Show 'waiting for pipeline...' when /dev/shm empty
- Add chicken-dashboard.service for systemd auto-start

Auto-init DB on dashboard start if file missing e7c26d3f86

_init_db() creates the schema at startup so /api/db/*
endpoints work immediately without needing a batch run first.

Add optimized batch config, remove large model files from tracking f9fc6c0571

- Add configs/cycle7_batch_optimized.yaml with tuned thresholds
- Update BatchConfig: add location and db_path fields
- Remove .pt/.onnx/.engine files from tracking (too large for git)
- Clean untracked test artifacts

Create test run 3eeb20ca56

Fix test_run.sh: alias->CMD (aliases don't work in scripts) 8cb5b01c00

consolidated models and db 94c4dd81a7

Database b9f4ba2ef8

Fix dashboard freeze: waitress, reduce frame refresh, atomic reads 6cddf2c9d3

- Switch Flask dev server -> waitress (8 threads, production WSGI)
- Only refresh frame.jpg when frame_index changes, not every second
- Safety try/except on send_file for edge-case file conflicts
- Fix test_run.sh: export PYTHONPATH, use venv python
- Update service file to use venv python

Today Commit 3b524d4a65

Export Session c05f3d98d0

feat: add engine auto-recompilation, mortality detection, multi-execution batching, and dashboard updates 010f6e1493

- Add engine_utils for TensorRT compatibility verification, auto-recompilation from .pt models, and YAML auto-updates
- Add mortality detection pipeline (mortality.py, test_run_mortality.sh, mortality_config.yaml)
- Add multi-execution batch modes (parallel_processes, tensor_batching, hybrid) in batch_runner.py
- Add daily test run automation scripts and video processing runners
- Add dashboard REST API, live stream endpoints, and web UI templates
- Clean up git tracking by ignoring __pycache__, .pyc, and build artifacts

docs: update README and RUN guides with engine auto-recompilation details a2f44167a2

docs: clarify that 2-pass mortality detection is disabled by default for higher accuracy ec7226d172

feat: add full cycle_start_date REST API, YAML persistence, and CORS support to dashboard.py 6723701424

feat: implement K{coop}-L{floor} standard, smart discovery, multi-coop runner, and move test runs to test_run_folder b00923dc2b

style: format K*-L*.yaml configs with exact inline comments and flow-style [x, y] coordinates 8fe2f88f12

fix: ensure robust PROJECT_ROOT path resolution in all test_run_folder scripts 5ad4a5f796

feat: implement config inheritance via 'extends' and place lightweight floor configs in configs/floor_config/ f9c38e5126

feat: add 3rd floor configs (K1-L3, K2-L3, K3-L3) and auto-discovery in run_all_coops.sh 127f3c59b2

feat: add coop filtering and directory pre-check to run_all_coops.sh acd9c9265b

fix: make chicken-dashboard.service dynamic, add install_service.sh, and add sibling VIDEOS startup checks 9f4fc138ba

fix: resolve multi-threading DB concurrency, disk traversal caching, and coops discovery 2061fbf08c

docs: update README, RUN guide, and add CHANGELOG for recent bugfixes and optimizations d9daf0ab01