Commit Graph

60 Commits

Author SHA1 Message Date
Accusys
2cfcfdd1af feat: Phase 2.6 edges migration to Qdrant (TKG-only architecture)
Phase 2.6.1: co_occurrence_edges migration
- build_co_occurrence_edges_from_qdrant()
- Qdrant embeddings → frame grouping → YOLO objects
- Result: 6679 edges (vs 6701 PostgreSQL)

Phase 2.6.2: face_face_edges migration
- build_face_face_edges_from_qdrant()
- Qdrant embeddings → frame grouping → face pairs
- mutual_gaze detection preserved
- Result: 6 edges (exact match)

Phase 2.6.3: speaker_face_edges migration
- build_speaker_face_edges_from_qdrant()
- Qdrant embeddings → trace_id frame ranges
- SPEAKS_AS edge creation

Architecture:
- All edges use Qdrant payload (no face_detections queries)
- PostgreSQL fallback for empty Qdrant
- Estimated 3.6x performance improvement

Testing:
- Playground (3003): ✓ All Phase 2.6 logs verified
- Edge counts: ✓ Close match with PostgreSQL
- Fallback: ✓ Working

Docs:
- docs_v1.0/DESIGN/TKG_PHASE2_6_EDGES_MIGRATION.md
- docs_v1.0/M4_workspace/2026-06-21_phase2_6_test.md
2026-06-21 04:47:49 +08:00
Accusys
0afc70fc5b test: Production (3002) Phase 2.5 release verification
Test results:
- TKG rebuild: 1.75s (2.4x faster than Playground)
- gaze_trace_nodes: 21 (PostgreSQL fallback)
- lip_trace_nodes: 21 (PostgreSQL fallback)
- Rule2 chunks: 75 ✓

Findings:
- Production faster than Playground (1.75s vs 4.2s)
- Qdrant collection empty (0 points)
- Using PostgreSQL fallback for Phase 2.5
- New videos will auto-populate Qdrant

Status:  Release successful
2026-06-21 04:31:52 +08:00
Accusys
c39805bb8e feat: Phase 2.5 gaze_trace and lip_trace Qdrant migration + Charade Q&A test
Phase 2.5.1: gaze_trace_nodes from Qdrant
- build_gaze_trace_nodes_from_qdrant()
- Read trace_id, frame, bbox from Qdrant payload
- Compute gaze stats (yaw, pitch, roll, gaze direction, blink)
- No PostgreSQL face_detections dependency

Phase 2.5.2: lip_trace_nodes from Qdrant + face.json
- build_lip_trace_nodes_from_qdrant()
- Match trace_id using Qdrant embeddings + face.json bbox
- Compute lip stats (openness, variance, speaking frames)
- Fixed face.json bbox structure (x,y,width,height not bbox object)

Test results:
- 23 gaze_trace nodes from Qdrant
- 23 lip_trace nodes from Qdrant + face.json
- 51 lip_sync edges created
- Charade Q&A: 20 identities, 75 relationship chunks

Docs:
- TKG_PHASE2_NONFACE_MIGRATION_V1.0.md (migration plan)
- 2026-06-21_charade_qa_test.md (Q&A test report)
2026-06-21 02:17:08 +08:00
Accusys
23c440104b feat: Phase 2-3 TKG-only architecture
Phase 2.1: build_face_trace_nodes_from_qdrant()
- Read trace_id, frame, bbox directly from Qdrant payload
- No dependency on face_detections table

Phase 2.3: Rule2 queries TKG nodes
- identity resolution from tkg_nodes.properties.identity_id
- TKG-only architecture (Phase 2.3)

Phase 3: Identity Agent updates TKG nodes
- match_faces_iterative() updates tkg_nodes.properties
- bind_identity_trace() syncs identity_id to TKG
- unbind_identity() removes identity_id from TKG

Test results:
- 23 face_trace nodes from Qdrant (Phase 2.1)
- 75 relationship chunks (Rule2)
- TKG rebuild: Phase0 → Phase1 → Phase2
2026-06-21 01:30:04 +08:00
Accusys
e1572907ae feat: ASRX hybrid pipeline, identity history, worker fixes, checkpoint system 2026-06-02 07:13:23 +08:00
Accusys
874d688987 feat: deploy hybrid search (semantic+keyword+identity) with RRF fusion
- Replace smart_search with hybrid RRF implementation
- Add speaker_detections table for identity-agent binding
- Fix identity queries: direct SQL to avoid type mismatches
- Add debug logs to job_worker for processor debugging
- Deployed to production (3002) successfully

Key changes:
- search.rs: Complete rewrite with 3 strategies + RRF
- postgres_db.rs: speaker_detections table + identity query fixes
- job_worker.rs: Debug logs for output file checks

Tested:
- Hybrid search works with semantic + keyword + identity
- Identity search: 'identity:Charade' returns correct results
- Chinese keyword search: '調光' matches Charade summaries

Bugs found:
- Case mismatch: 'ASRX' vs 'asrx' in processors field
- Missing CUT dependency for ASRX processor
2026-06-01 15:15:17 +08:00
Accusys
04cbb71ca0 docs: save handoff - library page flash & filter fix 2026-05-29 23:12:09 +08:00
Accusys
e96cc8c8de docs: record WordPress API URL update session progress 2026-05-29 19:06:15 +08:00
Accusys
eec2eea880 docs: file_uuid generation rules for M4 2026-05-17 02:26:09 +08:00
Accusys
3a6c186575 docs: add REFERENCE docs, M4 workspace, Caddyfile 2026-05-16 03:11:32 +08:00
Accusys
9cf20d3f8e docs: reclassify — DESIGN→STANDARDS, conversion→M5_workspace, cleanup 2026-05-15 12:18:29 +08:00
Accusys
802beb2db6 docs: RCA — identity_uuid missing + file identities NULL appearance 2026-05-15 10:59:23 +08:00
Accusys
a66bd6b7c2 chore: track M4's register_api_404 report 2026-05-15 03:28:38 +08:00
Accusys
263f017972 revert: remove /api/v1/register alias — not a valid endpoint, corrected M4 to use /api/v1/files/register 2026-05-15 03:12:32 +08:00
Accusys
e5f2bba248 fix: add /api/v1/register alias for backward compatibility 2026-05-15 03:08:56 +08:00
Accusys
11f690ca35 docs: fix start/end → start_frame/end_frame in API docs 2026-05-14 17:57:00 +08:00
Accusys
26f243428d docs: pipeline services checklist for M4 2026-05-14 17:05:18 +08:00
Accusys
c589eb10cf docs: respond to M4 binary crash analysis 2026-05-14 16:32:02 +08:00
Accusys
159684331e feat: GDINO A+B — time-bounded search (9s vs 130s) + parameterized interval 2026-05-14 13:57:25 +08:00
Accusys
2b633174b9 docs: reply to M4 with freshly built binary from HEAD 2026-05-14 03:45:55 +08:00
Accusys
0bd23fabd0 docs: M5 progress report — face tracker, bug fixes, pipeline 2026-05-14 03:37:01 +08:00
Accusys
79e455cc3d docs: deliver cut-based trace merge package 2026-05-14 03:12:55 +08:00
Accusys
4e933a554c docs: reply to M4 on trace schema hardcode fix 2026-05-14 02:56:59 +08:00
Accusys
edadb022e1 docs: notify M4 of trace video mode param 2026-05-14 02:48:15 +08:00
Accusys
d4386aba1b docs: notify M4 of binary + source delivery 2026-05-14 02:34:53 +08:00
Accusys
7e068f5bb9 docs: reply to M4 deploy report — clarify trace/TKG counts, identities issue 2026-05-14 01:58:43 +08:00
Accusys
11ec006947 docs: reply to M4 --force request 2026-05-14 01:54:09 +08:00
Accusys
f482705b9b docs: deliver pipeline v2 package to M4 — cut-aware traces + TMDB + TKG 2026-05-14 01:36:26 +08:00
Accusys
118a386f47 docs: notify M4 of trace video audio fix + updated binary 2026-05-13 23:46:52 +08:00
Accusys
abca3f67ff fix: drop redundant chunk_vectors chunk_id unique constraint 2026-05-13 22:42:03 +08:00
Accusys
1642a4b817 docs: reply to M4 release fixes — pre-clean all tables + SCHEMA variable 2026-05-13 22:05:53 +08:00
Accusys
96a96b4e88 docs: release delivery — binary + 2 packages 2026-05-13 21:11:31 +08:00
Accusys
301da0810f fix: M5 provides release binary, not M4 2026-05-13 21:05:08 +08:00
Accusys
d4864121b7 docs: reply to M4 release decision request — 6 items with rationale 2026-05-13 21:00:43 +08:00
Accusys
50d38a5473 docs: reply to M4 on REQUIRED_FILES fix 2026-05-13 20:20:36 +08:00
Accusys
1d69a88741 fix: deploy.sh build check lenient + per-file import order (M4 feedback)
- Accept SRV_BUILD=unknown (skip build check, only compare version)
- Per-table import with explicit FK order (nodes before edges)
2026-05-13 20:15:44 +08:00
Accusys
78b7a10ace docs: add M4 notification protocol — standardize response format 2026-05-13 20:01:45 +08:00
Accusys
ffc30d7377 M4 handover: coordinate fixes, detector registry, deploy v2, YOLOv8s, identity lifecycle
- Fix swift_pose/swift_ocr Y-flip bugs (BUG-003~006)
- Add heuristic_scene module + post-processing trigger (replaces Places365)
- YOLOv5nu → YOLOv8s CoreML (+33% detections, +390% scene indicators)
- Per-table SQL export (split 4.7GB single file → 478MB max per table)
- Version/build check in deploy.sh (compare /health vs file_info.json)
- Add file_uuid column to identities table + backfill
- Identity pre-clean step in deploy (avoids UNIQUE conflicts on re-deploy)
- Stranger_xxx naming fix with UUID context
- Add DETECTOR_REGISTRY.md (25 detectors), DETECTOR_SELECTION_SOP.md
- Update SPATIAL_COORDINATE_REGISTRY.md (P layer, 6-layer architecture)
- New IDENTITY_LIFECYCLE.md
- M4 response docs for deploy_script_fix and 111614 test report
2026-05-13 20:00:47 +08:00
Accusys
d34bcae145 fix: M4 api_test v2 compatibility — chunk ID format + response
- Fix chunk/0-01 → chunk/0 (v2.0 sequential chunk IDs)
- Identity UUID 2b0ddefe (Cary Grant) confirmed working in v2.0
- api_test.sh: 39/39 passed
- Response doc to M4_HANDOVER/ + M4_workspace/
2026-05-13 05:00:59 +08:00
Accusys
2992a0e650 feat: service inventory, ERP reports, sqlite-vec integration, visualize tool
- Add SERVICE_INVENTORY_V1.0.0.md (25 source-verified tools, 3.7GB)
- Add ERP_SELECTION_REPORT.md (Odoo CE vs ERPNext comparison)
- Add SFTPGO_ODOO_REPLACEMENT.md (SFTPGo migration plan)
- Add SERVICE_GO_GITEA_BUILD.md (Go compiler + Gitea build report)
- Add release visualize command (face trace heatmap + identity filter)
- Add sqlite-vec integration (160MB SQLite with vec0 vector tables)
- Add export_identities.py, export_sqlite.py, render_face_heatmap.py
- Add Go, Gitea, Rust/Cargo, Swift, yt-dlp, SQLite, sqlite-vec to service CLI
- Fix package to include identities and identity_bindings in data.sql
- Update release list to show all deployed video stats
- Add V1.0.0 YAML frontmatter to all docs (DOCS_STANDARD compliant)
2026-05-13 02:37:45 +08:00
Accusys
cac60c6093 fix: M4 Phase 1 bugs - dev.chunks refs, search_path, uuid column
Bug fixes from M4 report:
- 4 remaining dev.chunks → dev.chunk in SQL queries
- search_path includes public for pgvector extension
- get_chunk_by_chunk_id_and_uuid: uuid → file_uuid
- New endpoint: GET /api/v1/file/:uuid/chunk/:chunk_id
2026-05-11 10:21:06 +08:00
Accusys
39ba5ddf76 feat: Phase 1 handover - schema migration, correction mechanism, API fixes
Schema changes: dev.chunks->dev.chunk, remove old_chunk_id/chunk_index
Correction: asr-1.json format, generate/apply scripts
API: 37/37 endpoints fixed and tested
Docs: HANDOVER_V2.0.md for M4
2026-05-11 07:03:22 +08:00
Accusys
e068b70777 docs: git bundle instructions for M4 (SSH disabled) 2026-05-09 06:25:45 +08:00
Accusys
a0774cb9ab feat: wire TKG builder into worker pipeline + face-face edges
- Auto-run tkg_builder.py after face trace store + Qdrant sync + trace chunks
- Add face-face CO_OCCURS_WITH edges (two traces in same frame)
- docs: TKG integration report for M4
2026-05-09 06:22:27 +08:00
Warren
f469197ce6 M4: add ffmpeg-full licensing evaluation for M5's doc 2026-05-08 13:28:16 +08:00
Warren
606405b941 M4: suggest replace bitmap font with drawtext filter 2026-05-08 13:21:40 +08:00
Warren
ac59789f6e Merge branch 'main' of 192.168.110.201:/Users/accusys/momentry_core_0.1/ 2026-05-08 13:16:28 +08:00
Accusys
14d95cab8e Notify M4: video endpoints root cause 2026-05-08 13:16:05 +08:00
Warren
6ee2607f67 M4: add ffmpeg-full install status to response 2026-05-08 13:11:06 +08:00
Warren
ebe8722e1f M4: response to ffmpeg evaluation - ARG_MAX is the root cause 2026-05-08 13:06:27 +08:00