AI tools

promptfoo

An open source toolkit for testing, evaluating, and regression-checking LLM prompts and agents.

Open original

What it is

promptfoo is a useful bridge between product prompt work and engineering discipline: it makes behavior testable before a change ships.

Why worth a look

An open source toolkit for testing, evaluating, and regression-checking LLM prompts and agents.

Good for

  • Turning prompt experiments into repeatable test cases.
  • Catching regressions when changing prompts, models, or tools.

How to start

  1. Write three representative inputs and one clear expected behavior.
  2. Run a small eval before expanding the test matrix.

Best first click

Open promptfoo and start here: Write three representative inputs and one clear expected behavior.

Trust facts

Pricing
Free
Login required
No
Open source
Yes
API available
No
License
Open-source license; verify the project repository.
Risk
Pricing, login requirements, and availability can change; last human check: 2026-07-08.

Similar gems

Source links