vitals-package {vitals} | R Documentation |
vitals: Large Language Model Evaluation
Description
A port of 'Inspect', a widely adopted 'Python' framework for large language model evaluation. Specifically aimed at 'ellmer' users who want to measure the effectiveness of their large language model-based products, the package supports prompt engineering, tool usage, multi-turn dialog, and model graded evaluations.
Author(s)
Maintainer: Simon Couch simon.couch@posit.co (ORCID)
Other contributors:
Max Kuhn max@posit.co [contributor]
Hadley Wickham hadley@posit.co (ORCID) [contributor]
Mine Cetinkaya-Rundel mine@posit.co (ORCID) [contributor]
Posit Software, PBC (03wc8by49) [copyright holder, funder]
See Also
Useful links:
Report bugs at https://github.com/tidyverse/vitals/issues
[Package vitals version 0.1.0 Index]