promptfoo Gem
Test and compare LLM prompts and models with assertions, locally or in CI.
Instead of: Eyeballing prompt changes in a playground
6 tools
Test and compare LLM prompts and models with assertions, locally or in CI.
Instead of: Eyeballing prompt changes in a playground
An offline API client that stores collections as plain text files in your repo.
Instead of: Postman / Insomnia cloud collections
A local SMTP server and web inbox for testing the emails your app sends.
Instead of: MailHog (unmaintained), sending test emails to your own address
Spin up real databases and services in Docker from inside your tests.
Instead of: Mocked database layers, shared test databases, hand-written docker-compose setup
Test your Ansible roles and collections in throwaway containers or VMs.
Instead of: Running playbooks against a shared dev box and hoping
A fast JavaScript runtime, package manager, bundler and test runner in one binary.
Instead of: Node.js + npm + ts-node + Jest + a bundler