Skip to content

Roadmap

Completed ✅

  • [x] Adapter for testset from CSV
  • [x] Documentation via mkdocs
  • [x] LLMJudge evaluator
  • [x] MLflow integration
  • [x] Custom evaluator support

In Progress 🚧

  • [ ] Adapter for task from CSV
  • [ ] Tests with test-docker containers
  • [ ] Track git-commit hash in evaluations

Planned 📋

Short Term (Next Release)

  • [ ] More Built-in Evaluators
  • Regex pattern evaluator
  • Length/word count evaluator
  • Sentiment analysis evaluator
  • Entity extraction evaluator

Feedback

Have thoughts on the roadmap? We'd love to hear from you!

  • Open an issue on GitHub
  • Start a discussion
  • Reach out to the maintainers

Last updated: February 2026