# Supplied ranking evaluation

Build-time release reference. Runtime readiness, deployment, payment settlement and external indexing are not evaluated here. Prices are proposed; this file cannot authorize execution or payment.

Score ranked document IDs against caller-supplied graded judgments for up to 50 queries: precision/recall, reciprocal rank, truncated average precision and NDCG at k. Explicit gain, unjudged and zero-denominator conventions; evidence lists ranked judgments and missed relevant IDs. No search or relevance inference.

Release: 0.29.0. Built: 2026-10-06T15:38:00Z.

## Choose for
- evaluate retrieval ranking ndcg map mrr precision recall at k
- score search results against supplied relevance judgments
- compare RAG retrieval quality using judged document ids

## Outside this profile
- Search the web or determine semantic document relevance
- Claim benchmark completeness from partial judgments

Proposed nominal USD 0.01 per successful call; payer fees excluded. No verified runtime availability.

- [Exact release contract](/reference/services/ranking-evaluate.json)
- [Input schema](/reference/schemas/ranking-evaluate.input.json)
- [Output schema](/reference/schemas/ranking-evaluate.output.json)
- [Fixed example](/reference/examples/ranking-evaluate.json)
- [Complete HTML reference](/discover/tools/ranking-evaluate)
