chaim
83a3f63a37
Extends scripts/fetch_national_insurance_law.py with a --regulations mode that pulls all canonical (non-redirect) תקנות הביטוח הלאומי pages from the MediaWiki API and writes <slug>.txt + <slug>.txt.meta.json pairs ready for the existing scan-inbox cron. Used to seed the live insurance KB with 92 regulations (~1,500 chunks, ~22MB Postgres) on dev. Wikisource's redirect graph dedups spelling variants (קיצבה/קצבה, etc.) for free. Bumps version to 0.2.0. Refs Task Master #3 Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
51 lines
3.1 KiB
JSON
51 lines
3.1 KiB
JSON
{
|
|
"master": {
|
|
"tasks": [
|
|
{
|
|
"id": "1",
|
|
"title": "Discovery tools + medical_case_analysis skill",
|
|
"description": "Add browse_folder/find_case_folder/set_case_folder_path tools, enrich list_documents with diagnostic, update prompt rules, and add medical_case_analysis skill.",
|
|
"details": "",
|
|
"testStrategy": "",
|
|
"status": "in-progress",
|
|
"dependencies": [],
|
|
"priority": "medium",
|
|
"subtasks": [],
|
|
"updatedAt": "2026-04-19T06:11:18.162Z"
|
|
},
|
|
{
|
|
"id": "2",
|
|
"title": "feat(kb): Phase 1 — Israeli National Insurance KB",
|
|
"description": "Phase 1 of the Israeli National Insurance knowledge base. Create insurance_kb database on the shared PostgreSQL instance with pgvector and pg_trgm extensions. Schema: kb_source (law/regulation/circular + supersession) and kb_chunk (content, heading_path, section_ref, tsvector, vector(1024) with HNSW cosine index). Create MinIO bucket insurance-kb. Add KB module to shira-hermes: config, asyncpg pool, Voyage client, parse+chunk+embed pipeline, hybrid search with RRF, search_insurance_kb tool (registered in mcp_server), POST /admin/kb/ingest, GET /admin/kb/stats. Store KB_DATABASE_URL in Infisical /espocrm. Validate end-to-end by ingesting 2-3 sample circulars and issuing a semantic query via the tool.",
|
|
"details": "See plan in conversation on 2026-04-21. Chunking strategy differs per kind: laws/regulations split by section; circulars split header-aware ~600 tokens with 80 overlap. Supersession: soft (superseded_by FK) not delete. Dependencies to add: asyncpg, voyageai (or REST via httpx), python-docx. Voyage model: voyage-multilingual-2, dim=1024, input_type=document for ingest / query for search.",
|
|
"testStrategy": "Manual: upload 2-3 sample PDF circulars via POST /admin/kb/ingest, verify kb_source + kb_chunk rows, verify embedding column non-null, call search_insurance_kb with a Hebrew query and confirm top-k results cite the right section_ref.",
|
|
"status": "in-progress",
|
|
"dependencies": [],
|
|
"priority": "high",
|
|
"subtasks": [],
|
|
"updatedAt": "2026-04-21T00:00:00.000Z"
|
|
},
|
|
{
|
|
"id": "3",
|
|
"title": "Add תקנות הביטוח הלאומי (~100 regulations) from Wikisource to KB",
|
|
"description": "Extend scripts/fetch_national_insurance_law.py to bulk-fetch ~100 regulation pages from Hebrew Wikisource via MediaWiki API. Output text + sidecar JSON pairs to /tmp/regulations/. Upload to MinIO inbox/regulation/ for the existing scan-inbox cron to embed via Voyage. Estimated 30-40MB Postgres growth, ~$0.36 embedding cost. Sample 3 first (small/medium/large), verify chunker output, then bulk.",
|
|
"details": "",
|
|
"testStrategy": "",
|
|
"status": "done",
|
|
"dependencies": [],
|
|
"priority": "high",
|
|
"subtasks": [],
|
|
"updatedAt": "2026-04-25T20:39:11.905Z"
|
|
}
|
|
],
|
|
"metadata": {
|
|
"version": "1.0.0",
|
|
"lastModified": "2026-04-25T20:39:11.905Z",
|
|
"taskCount": 3,
|
|
"completedCount": 1,
|
|
"tags": [
|
|
"master"
|
|
]
|
|
}
|
|
}
|
|
} |