5 Commits

Author SHA1 Message Date
6387a84558 Update README.md 2026-07-30 05:51:23 +00:00
ef44f52fa2 Update README.md 2026-07-28 19:33:22 +00:00
ab068ba43f Update README.md 2026-07-28 10:11:28 +00:00
58e85c00f8 Update ReadMe.md 2026-07-28 07:32:07 +00:00
S Jannette
6edee1df6e Merge pull request #2 from kjannette/update-README
update README.md
2026-05-09 18:15:39 -04:00

View File

@@ -61,6 +61,24 @@ When a user submits a query, the system enforces groundedness through a multi-l
of the cited chunks. The similarity is calibrated to a 01 scale and averaged, producing a single of the cited chunks. The similarity is calibrated to a 01 scale and averaged, producing a single
groundedness score that is surfaced to the user with a visual indicator (green/yellow/red). groundedness score that is surfaced to the user with a visual indicator (green/yellow/red).
## Similarity Metrics for Semantic Understanding - basics
Cosine similarity measures how closely two vectors (representing data like words, images, or preferences) are aligned in a multi-dimensional space by calculating the cosine of the angle between them.
Archetypical cosine scores range from -1 to 1.
1: Vectors point in the exact same direction (highly similar).
0: Vectors are at a 90-degree angle (orthogonal/unrelated).
-1: Vectors point in opposite directions.
## The role of rerank models
Rerankers are high-precision, fine second (or third) stage filters. Rerankers run "from scratch" on query-source/answer-source pairs and are computationally expensive.
A reranker assigns relevance scoring by evaluating query-source/answer-source pair similarity within a multi-dimensional vector space. They should be RAG-pipeline-downstream of embedding models, which are "coarse" - and occasionally yield false positives on semantically irrelevant chunks.
Reranker are justifiable and high-value where 1. accuracy is at an absolute premium because of the magnitude of downside risk (ex. uses cases: litigation, health care and medical research science) 2. token-economization heuristics exist at earlier pipeline stages, and 3. system and network latency reduction is optimized.
## Design ## Design
Two-package monorepo: Two-package monorepo: