Skip to content

Latest commit

 

History

History
24 lines (17 loc) · 389 Bytes

roadmap.md

File metadata and controls

24 lines (17 loc) · 389 Bytes

Roadmap

Phase 1: Benchmark Core

  • dataset format
  • exact strategy
  • canonical strategy
  • semantic strategy stub
  • judge rubric
  • HTML and JSON report

Phase 2: Hosted Evaluation

  • larger replay runs
  • hosted judge
  • report upload
  • NextModel cost estimate

Phase 3: Production Policy

  • production gateway policy export
  • bad hit regression set
  • safe cache rule generation