System Health Dashboard
Operational and pipeline health metrics. These numbers reflect system throughput, coverage, and reliability — they are not measures of accuracy or question quality.
Overall Pipeline Success Rate
97.0%
Mean of pipeline completion rates
Embedding Coverage
100.0%
Chunks with computed embeddings
Avg. Processing Time
98.37s
Upload session end-to-end
System Operational Metrics
Methodology: These metrics track the operational state of the vector store and ingestion pipeline. Embedding coverage indicates how many chunks are searchable. Topic label coverage shows the richness of metadata attached to textbook chunks. Pending counts reflect current system load.
Textbook Chunks
22863
22863 with embeddings
Uploaded Chunks
5328
5328 with embeddings
Chunks / Session
63.4
Average per upload session
Topic Label Coverage
0.0%
Textbook chunks with topic metadata
Pending / Processing
0
Quizzes currently in flight
Total Chunks
28191
Textbook + uploaded combined
Chunk Embedding Coverage
RAG Component Distribution
Pipeline Operational Metrics
Summary Success Rate
97.5%
79 completed / failed
Quiz Success Rate
93.6%
73 completed / failed
Recommendation Success Rate
100.0%
105 completed / failed
Pipeline Success Rates
Provider Operational Metrics
GenerationMetric Performance
| Type | Success Rate | Avg Duration | Cache Hit |
|---|---|---|---|
| summary | 87.9% | 35333 ms | 40.2% |
| quiz | 98.3% | 29685 ms | 50.9% |
| recommendations | 100.0% | 1300 ms | 0.8% |
Error Analysis
Methodology: Errors are grouped by pipeline stage and surfaced verbatim (truncated) to ensure reproducibility. Counts indicate frequency of each failure mode.
Quiz Generation Errors
| Error | Count |
|---|---|
null value in column "content_lineage_verified" of relation "quiz_question" violates not-null constraint
DETAIL: Faili… |
1 |
null value in column "content_lineage_verified" of relation "quiz_question" violates not-null constraint
DETAIL: Faili… |
1 |
null value in column "content_lineage_verified" of relation "quiz_question" violates not-null constraint
DETAIL: Faili… |
1 |
null value in column "content_lineage_verified" of relation "quiz_question" violates not-null constraint
DETAIL: Faili… |
1 |
null value in column "content_lineage_verified" of relation "quiz_question" violates not-null constraint
DETAIL: Faili… |
1 |
Upload Processing Errors
| Error | Count |
|---|---|
AI provider request timed out after 120 seconds |
1 |
All concept extraction (map) calls failed. |
1 |