Skip to main content

PromptTools

PromptTools is an open-source library for experimenting with, testing, and evaluating prompts, LLMs, and vector databases.

Features​

PromptTools offers a playground for comparing prompts and models in three modes:

  • Instruction
  • Prompt template
  • Model comparison

In addition to the playground, PromptTools offers and SDK for writing tests and evaluation functions to experiment with and evaluate prompts at scale.

You can check out a tutorial video here.