trec_eval

Open source

Standard open-source utility for evaluating information retrieval runs with effectiveness metrics.

Pricing: free
Free tier: true
License: open-source
Open source: Yes

Editorial review

trec_eval has not yet been editorially reviewed. User reviews and published field data below are unaffected — we say so rather than implying an editorial verdict.

Facts & attributes

Every value carries its evidence state. “—” means unknown — never a silent default (P-02).

Identity · Taxonomy

Tags(open-source;cloud-native): information retrieval, evaluation, TREC, command line, researchVerification pending

Platform · Deployment

Delivery model(SaaS;self-hosted;desktop;mobile;embedded;managed-cloud;appliance): self-hostedVerification pending

Pricing · Licensing

Free plan(true/false): trueVerification pending
License model(proprietary;open-source;source-available;dual-license): open-sourceVerification pending
Pricing model(free;subscription;usage;seat;asset;transaction;revenue-share;perpetual;custom): freeVerification pending
Source repository(HTTPS URL): https://github.com/usnistgov/trec_evalVerified
SPDX license IDs(Apache-2.0;MIT): NIST-SoftwareVerification pending

Features · Product · Fit

Core capabilities(authoring;automation;analytics): Standard tool for evaluating an ad hoc retrieval run against a standard set of judged results, Dozens of measures including ndcg, map, bpref, recip_rank, rbp, success and set measures, Preference evaluation measures with dedicated input formats (prefs, qrels_prefs, qrels_jg), Per-query and averaged output via the -q flagVerification pending

Api · Integrations · Ecosystem

CLI(true/false): trueVerification pending

Audience · Use · Case

Best for(Neutral editorial summary): IR researchers and TREC participants evaluating retrieval runs with the community's standard scoring toolVerification pending
Primary use cases(build;monitor;automate): TREC ad hoc retrieval run evaluation, Information retrieval research evaluationVerification pending
Skill level(beginner;intermediate;advanced;specialist): advancedVerified

Vendor · Maintainer

Vendor type(commercial;foundation;community;government;consortium;individual): governmentVerified

User reviews

Review policy

No published reviews yet.