Plugin

promptfoo-evals

Teaches AI coding agents to create and maintain promptfoo eval suites. Encodes best practices like deterministic assertions first, file-based test organization, correct environment variable syntax, and proper hallucination/faithfulness checks. Includes a cheatsheet covering 30+ assertion types, provider patterns for OpenAI/Anthropic/Google/Bedrock/HTTP/Python/JS, and test patterns for JSON validation, dataset-driven scaling, and CI-friendly runs.

• Published source
• Repository

Analysed

11 October 2026

Last observed

11 October 2026

What the code does

Static analysis found none of the capabilities we track, such as shell commands, network requests or file writes, in the latest version.

Having a capability is not wrongdoing; many tools need these to do their job. It tells you what to check before you install.

This is public metadata, not a safety certification or complete assessment. Static analysis cannot establish what a tool does at runtime.