Inspect

Open source

Open source framework for evaluating and stress-testing large language models.

by UK AI Security InstituteOfficial site ↗Source code ↗

Pricing: free
Free tier: true
License: open-source
Open source: Yes

Editorial review

Inspect has not yet been editorially reviewed. User reviews and published field data below are unaffected — we say so rather than implying an editorial verdict.

Facts & attributes

Every value carries its evidence state. “—” means unknown — never a silent default (P-02).

Identity · Taxonomy

Documentation(HTTPS URL): https://inspect.aisi.org.ukVerified
Tags(open-source;cloud-native): open-source, ai-evaluations, government, agentsVerification pending

Platform · Deployment

Delivery model(SaaS;self-hosted;desktop;mobile;embedded;managed-cloud;appliance): self-hostedVerification pending

Pricing · Licensing

Free plan(true/false): trueVerification pending
License model(proprietary;open-source;source-available;dual-license): open-sourceVerification pending
Pricing model(free;subscription;usage;seat;asset;transaction;revenue-share;perpetual;custom): freeVerified
Source repository(HTTPS URL): https://github.com/UKGovernmentBEIS/inspect_aiVerified
SPDX license IDs(Apache-2.0;MIT): MITVerified

Features · Product · Fit

Core capabilities(authoring;automation;analytics): over 200 pre-built evaluations, agent evaluations, tool calling with MCP tools, sandboxing in Docker and Kubernetes, web-based evaluation viewerVerification pending

Api · Integrations · Ecosystem

API available(true/false): trueVerification pending
CLI(true/false): trueVerification pending

Audience · Use · Case

Best for(Neutral editorial summary): Open-source MIT framework from the UK AI Security Institute for frontier AI evaluations, with 200+ built-in benchmarks and agent sandboxing.Verification pending
Primary use cases(build;monitor;automate): large language model evaluations, agentic task evaluation, benchmark runningVerification pending

Lifecycle · Versioning

Current version(1.12.3): 0.3.287Verified
Maintenance status(active;maintenance;deprecated;EOL;archived): activeVerification pending

Vendor · Maintainer

Founded year(2012): 2023Verified
Headquarters country(US): United KingdomVerification pending
Vendor type(commercial;foundation;community;government;consortium;individual): governmentVerified

User reviews

Review policy

No published reviews yet.