Commit Graph

192 Commits

Author SHA1 Message Date
Accusys
605d02a674 feat: trace video shows frame number overlay 2026-05-14 02:30:40 +08:00
Accusys
3a7facdc10 fix: face tracker — add iou>0.35+dist<100 condition for same-position matching 2026-05-14 02:26:37 +08:00
Accusys
7e068f5bb9 docs: reply to M4 deploy report — clarify trace/TKG counts, identities issue 2026-05-14 01:58:43 +08:00
Accusys
11ec006947 docs: reply to M4 --force request 2026-05-14 01:54:09 +08:00
Accusys
1023930f73 feat: deploy.sh --force flag to skip overwrite confirmation 2026-05-14 01:53:59 +08:00
Accusys
f482705b9b docs: deliver pipeline v2 package to M4 — cut-aware traces + TMDB + TKG 2026-05-14 01:36:26 +08:00
Accusys
b66d7963c2 fix: store_traced_faces — embed from DB, UPDATE not INSERT, dedup 2026-05-14 00:32:39 +08:00
Accusys
74f00d3baa fix: face traces split at scene cuts — even same person, different cut 2026-05-14 00:21:17 +08:00
Accusys
9007e46b9f fix: trace video bbox no longer extends beyond last detection 2026-05-14 00:14:52 +08:00
Accusys
690254a5b2 fix: face tracker — reject cross-person match on bbox size + edge exit 2026-05-14 00:05:57 +08:00
Accusys
70a796e16c fix: face tracker embedding threshold — reject similarity < 0.5, tighten fallback to >0.75 2026-05-14 00:02:39 +08:00
Accusys
118a386f47 docs: notify M4 of trace video audio fix + updated binary 2026-05-13 23:46:52 +08:00
Accusys
adae263065 fix: add audio (aac) to trace video API 2026-05-13 23:46:06 +08:00
Accusys
abca3f67ff fix: drop redundant chunk_vectors chunk_id unique constraint 2026-05-13 22:42:03 +08:00
Accusys
65a1b55215 feat: add macmon + mactop build steps to install_services.sh 2026-05-13 22:40:41 +08:00
Accusys
1642a4b817 docs: reply to M4 release fixes — pre-clean all tables + SCHEMA variable 2026-05-13 22:05:53 +08:00
Accusys
6cd41ed71f fix: deploy.sh pre-clean all tables + SCHEMA var for public/dev 2026-05-13 22:05:35 +08:00
Accusys
96a96b4e88 docs: release delivery — binary + 2 packages 2026-05-13 21:11:31 +08:00
Accusys
301da0810f fix: M5 provides release binary, not M4 2026-05-13 21:05:08 +08:00
Accusys
d4864121b7 docs: reply to M4 release decision request — 6 items with rationale 2026-05-13 21:00:43 +08:00
Accusys
2cf962bc70 docs: update DELIVERY_PROCEDURE to v1.1 — add self-verify, version strategy, rollback, deploy details 2026-05-13 20:54:58 +08:00
Accusys
7ae8ccafb8 docs: add DELIVERY_PROCEDURE.md — M4_workspace → M5 → Public Release 2026-05-13 20:52:01 +08:00
Accusys
edb0e0bf7a fix: bundle vec0.dylib in package + deploy install (4/4 M4 items) 2026-05-13 20:46:29 +08:00
Accusys
e6aa45d7ea fix: /files total count from DB (was hardcoded 0) 2026-05-13 20:45:23 +08:00
Accusys
2e7dd44552 fix: scan extensions add jpg/png, /files status from DB (2/4 M4 items) 2026-05-13 20:43:37 +08:00
Accusys
50d38a5473 docs: reply to M4 on REQUIRED_FILES fix 2026-05-13 20:20:36 +08:00
Accusys
fcaaeadf06 fix: deploy.sh missing REQUIRED_FILES variable 2026-05-13 20:20:26 +08:00
Accusys
1d69a88741 fix: deploy.sh build check lenient + per-file import order (M4 feedback)
- Accept SRV_BUILD=unknown (skip build check, only compare version)
- Per-table import with explicit FK order (nodes before edges)
2026-05-13 20:15:44 +08:00
Accusys
3dc09cf802 docs: add M4 notification protocol to AGENTS.md 2026-05-13 20:04:44 +08:00
Accusys
78b7a10ace docs: add M4 notification protocol — standardize response format 2026-05-13 20:01:45 +08:00
Accusys
ffc30d7377 M4 handover: coordinate fixes, detector registry, deploy v2, YOLOv8s, identity lifecycle
- Fix swift_pose/swift_ocr Y-flip bugs (BUG-003~006)
- Add heuristic_scene module + post-processing trigger (replaces Places365)
- YOLOv5nu → YOLOv8s CoreML (+33% detections, +390% scene indicators)
- Per-table SQL export (split 4.7GB single file → 478MB max per table)
- Version/build check in deploy.sh (compare /health vs file_info.json)
- Add file_uuid column to identities table + backfill
- Identity pre-clean step in deploy (avoids UNIQUE conflicts on re-deploy)
- Stranger_xxx naming fix with UUID context
- Add DETECTOR_REGISTRY.md (25 detectors), DETECTOR_SELECTION_SOP.md
- Update SPATIAL_COORDINATE_REGISTRY.md (P layer, 6-layer architecture)
- New IDENTITY_LIFECYCLE.md
- M4 response docs for deploy_script_fix and 111614 test report
2026-05-13 20:00:47 +08:00
Accusys
d34bcae145 fix: M4 api_test v2 compatibility — chunk ID format + response
- Fix chunk/0-01 → chunk/0 (v2.0 sequential chunk IDs)
- Identity UUID 2b0ddefe (Cary Grant) confirmed working in v2.0
- api_test.sh: 39/39 passed
- Response doc to M4_HANDOVER/ + M4_workspace/
2026-05-13 05:00:59 +08:00
Accusys
5c1d8a67b2 docs: M4 handover V2.0 — complete package with TMDB, sqlite-vec, deploy scripts
- Package v20260512_203344.tar.gz: 1.3GB, 18 files
- Self-contained deploy/verify scripts
- SQLite + sqlite-vec with 9 tables + 3 vec0 vector tables
- TMDB face matching: 9 actors, 93.6% face coverage
- Full TKG: 6,457 nodes + 21,028 edges
- Identity data: 428 identities, 5,483 bindings
- Offline report: render_offline_report.py
- All reports: ERP, SFTPGo, Service Inventory
2026-05-13 04:40:30 +08:00
Accusys
c0c0e6e8ea feat: self-contained deploy/verify scripts in release package
- Add deploy.sh: imports data.sql, copies video, copies output files, verifies
- Add verify.sh: checks file integrity + DB/offline status
- Both scripts included in tar.gz via release package command
- Package now deployable standalone without release CLI
2026-05-13 04:35:43 +08:00
Accusys
48c3b13c37 fix: restore identity_id after face_dedup, rebuild package v20260512
- Re-ran identity_bind.py to restore identity_id on face_detections
- Dedup cleanup had removed rows with identity_id, kept NULL rows
- 70691 face_detections now have identity_id, 428 identities
- Full package rebuild: 169MB sqlite, 1358MB tar.gz
- identities.json: 428 identities + 5483 bindings + 5483 trace maps
- TMDB matching complete: Audrey Hepburn 843 traces, Cary Grant 482
2026-05-13 04:30:18 +08:00
Accusys
fff2af8ad1 fix: identity names now show in all trace tooltips (online + offline)
- Online: remove IDENTITY filter gating on identity_note — always show
- Offline: fix id_names scope bug — was overwritten by top10-only dict
- Both reports now show 'identity: PERSON_xxx' for all 2000 timeline traces
- All 5483 traces have identity mapping (verified in SQLite)
2026-05-13 03:19:26 +08:00
Accusys
8d4d29ce6e fix: offline report shows identity names in trace tooltips
- Load trace_to_identity mapping from SQLite face_detections
- Query identity names from identities table
- Show 'identity: PERSON_xxx' in each trace bar tooltip
- Works in both full view and --identity filtered view
2026-05-13 03:14:49 +08:00
Accusys
bbf8e64752 feat: offline report from SQLite, no PostgreSQL needed
- Add render_offline_report.py — reads .sqlite directly
- Reports include: DB contents, TKG breakdown, density histogram,
  trace timeline, top identities, identity details card
- Supports --identity filter (like online mode)
- Add release visualize-offline <sqlite> [-i identity] [-o output]
- Works with exported .sqlite from export_sqlite.py
- Uses sqlite-vec vec0 tables for vector metadata
2026-05-13 03:10:59 +08:00
Accusys
007fe10c2e feat: TKG completion, PG audit, SQLite backup with Qdrant voice vectors
- Add voice_embeddings vec0 table (192D) from Qdrant to SQLite export
- Add tkg_nodes + tkg_edges tables to SQLite export
- Clean orphan TKG data (2414 nodes, 64 chunks)
- Rebuild TKG for both Charade files with speaker nodes
- Create asrx.json from chunk speaker metadata for TKG builder
- PG audit: pre_chunks 1.8GB (largest), 3 empty tables found
- Update release package to include all output files (not just JSON)
- Full backup: 9 SQLite tables + 3 vec0 vector tables
2026-05-13 03:03:38 +08:00
Accusys
2992a0e650 feat: service inventory, ERP reports, sqlite-vec integration, visualize tool
- Add SERVICE_INVENTORY_V1.0.0.md (25 source-verified tools, 3.7GB)
- Add ERP_SELECTION_REPORT.md (Odoo CE vs ERPNext comparison)
- Add SFTPGO_ODOO_REPLACEMENT.md (SFTPGo migration plan)
- Add SERVICE_GO_GITEA_BUILD.md (Go compiler + Gitea build report)
- Add release visualize command (face trace heatmap + identity filter)
- Add sqlite-vec integration (160MB SQLite with vec0 vector tables)
- Add export_identities.py, export_sqlite.py, render_face_heatmap.py
- Add Go, Gitea, Rust/Cargo, Swift, yt-dlp, SQLite, sqlite-vec to service CLI
- Fix package to include identities and identity_bindings in data.sql
- Update release list to show all deployed video stats
- Add V1.0.0 YAML frontmatter to all docs (DOCS_STANDARD compliant)
2026-05-13 02:37:45 +08:00
Accusys
cac60c6093 fix: M4 Phase 1 bugs - dev.chunks refs, search_path, uuid column
Bug fixes from M4 report:
- 4 remaining dev.chunks → dev.chunk in SQL queries
- search_path includes public for pgvector extension
- get_chunk_by_chunk_id_and_uuid: uuid → file_uuid
- New endpoint: GET /api/v1/file/:uuid/chunk/:chunk_id
2026-05-11 10:21:06 +08:00
Accusys
39ba5ddf76 feat: Phase 1 handover - schema migration, correction mechanism, API fixes
Schema changes: dev.chunks->dev.chunk, remove old_chunk_id/chunk_index
Correction: asr-1.json format, generate/apply scripts
API: 37/37 endpoints fixed and tested
Docs: HANDOVER_V2.0.md for M4
2026-05-11 07:03:22 +08:00
Accusys
ef894a44ad docs: update Phase 1 report with all Qdrant collections + voice embeddings fix
- Fixed asrx_processor_custom.py: embeddings now passed to asrx.json
- Voice embeddings (192D ECAPA-TDNN) extracted for all 1815 ASRX segments
- momentry_dev_voice Qdrant collection created (1815 vectors)
- Updated Phase 1 report with 6 collections, key decisions
2026-05-10 01:11:42 +08:00
Accusys
d043b6adae docs: Phase 1 completion report + LLM reasoning off fix 2026-05-09 22:03:34 +08:00
Accusys
e7f311e7b8 docs: Phase 1 checklist 6 sections (含 face trace + TKG + identities)
release_pack.py: identities 併入 phase 1(不限 phase >= 2)
2026-05-09 18:14:22 +08:00
Accusys
6fc1d2b54d dashboard: copy button, dedup files, /api/all single call 2026-05-09 18:00:46 +08:00
Accusys
4f1e546104 feat: Momentry Dashboard web app (Flask)
- Realtime dashboard on port 5050
- Pipeline checklist (8 stages /)
- System health: CPU, memory, disk, GPU, 4 services
- Redis metrics: memory, clients, hit rate, keys
- DB table counts: videos, chunks, face_detections, identities, TKG
- Processor timing chart
- Auto-refresh every 15 seconds + manual refresh button

Usage: python3 scripts/dashboard.py
Open: http://localhost:5050
2026-05-09 17:43:26 +08:00
Accusys
06caea51e7 feat: pipeline status dashboard (checklist + health + timing)
Usage:
  python3 scripts/pipeline_status.py              # formatted table
  python3 scripts/pipeline_status.py --json        # machine-readable JSON

Shows:
- 8-stage checklist with pass/fail per stage
- System health: CPU, memory, disk, GPU, 4 services
- Processor timing from DB
- All in under 1 second
2026-05-09 17:29:38 +08:00
Accusys
fc16e7b1c3 fix: Phase 1 pipeline fully operational
- store_traced_faces.py: add --uuid arg for PythonExecutor compat
- tkg_builder.py: add --uuid arg + timestamp_secs column fix
- release_pack.py: fix pg_dump/psql paths, proper JSON escaping
- pipeline_checklist.py: new independent verification tool

Phase 1 checklist 8/8 PASS:
ASR  ASRX  sentence chunks  vector embeddings 
face trace  TKG graph  trace chunks  Phase 1 release 
2026-05-09 17:21:17 +08:00
Accusys
3a4fd4136d docs: wiki vs RAG distinction in model lifecycle
wiki is not traditional RAG:
- RAG: ephemeral query-time augmentation
- Wiki: permanent model corrections, versioned, packaged with model
- Edits accumulate across versions as ground truth
2026-05-09 14:28:47 +08:00