mirror of
https://github.com/Crosstalk-Solutions/project-nomad.git
synced 2026-05-28 23:26:50 +02:00
e68c753e39
When a user picks a tier in TierSelectionModal, show how much additional disk space the AI Assistant will need if the new ZIMs are indexed, plus a policy-aware footer explaining whether they'll auto-index (Always) or wait for opt-in (Manual). Estimates consume #891's KbRatioRegistry via a new POST /api/rag/estimate-batch endpoint. Backend - New POST /api/rag/estimate-batch route + RagController.estimateBatch - VineJS schema accepting array of {filename, sizeBytes}, capped at 500 - KbRatioRegistry.estimateBatch aggregates via the existing prefix-match lookup, returns {totalChunks, totalBytes, hasUnknown} - New BYTES_PER_CHUNK_ON_DISK constant (~8 KB: 3 KB vector + ~3 KB chunk text + ~2 KB payload/index overhead). Tunable; will be replaced by Phase 4 self-calibration once we have real measurements. - Controller normalizes incoming filenames via path.basename so callers that send full paths or URLs still match registry prefixes correctly. Frontend - api.estimateEmbeddingBatch() client method - TierSelectionModal: when localSelectedSlug is set, resolve the tier's resources (incl. inherited tiers), POST to /estimate-batch, and render a new info block with the +~X GB figure + ingest-policy copy. Also fetches rag.defaultIngestPolicy so the same block surfaces whether indexing will fire automatically or wait for the user. - resourceFilename() helper extracts the basename from the resource URL so the registry lookup hits the right prefix regardless of mirror. Tests - 4 new cases in tests/unit/kb_ratio_lookup.spec.ts covering the estimateBatch aggregator: standard sum, unknown-flagging, video-only ZIM (0 chunks but known, hasUnknown stays false), empty input. Stacks on feat/kb-ratio-registry (#891) — consumes the registry table seeded by that PR. Once #891 merges to rc, this PR auto-rebases. Out of scope for this PR (deferred to follow-ups): - Per-batch opt-in checkbox (RFC §1's '☑ Also index these for AI') needs a per-batch policy override path and is a separate PR - Guardrail modal at 50 GB / 10% free / 6 hr thresholds (RFC §7) is also separate; this PR is informational, not gating - Time-to-embed estimate awaits a chunks-per-second metric per host
28 lines
523 B
TypeScript
28 lines
523 B
TypeScript
import vine from '@vinejs/vine'
|
|
|
|
export const getJobStatusSchema = vine.compile(
|
|
vine.object({
|
|
filePath: vine.string(),
|
|
})
|
|
)
|
|
|
|
export const deleteFileSchema = vine.compile(
|
|
vine.object({
|
|
source: vine.string(),
|
|
})
|
|
)
|
|
|
|
export const estimateBatchSchema = vine.compile(
|
|
vine.object({
|
|
files: vine
|
|
.array(
|
|
vine.object({
|
|
filename: vine.string().minLength(1).maxLength(255),
|
|
sizeBytes: vine.number().min(0),
|
|
})
|
|
)
|
|
.minLength(1)
|
|
.maxLength(500),
|
|
})
|
|
)
|