We run our session-tracking prompt against standard scenarios and publish the results. This page is updated as new runs are evaluated.
| Scenario | Category | Turns | Expected Confidence |
|---|---|---|---|
| Linear — Straightforward Tracking scenario-linear-001 | linear | 5 | high |
| Drift — Mid-Session Topic Shift scenario-drift-001 | drift | 6 | high |
| Ambiguity — Unclear User Intent scenario-ambiguity-001 | ambiguity | 4 | medium |
| Iterative/Re-edit — Back-and-Forth Refinement scenario-iterative-001 | iterative | 7 | high |
| Large Context — Extended Multi-Topic Session scenario-large-context-001 | large_context | 15 | high |
| Failure Sim — Forced Write Denial scenario-failure-sim-001 | failure_sim | 4 | low |
| Context Decay — Recall Probe After Many Turns scenario-context-decay-001 | context_decay | 12 | high |
| File I/O Trace — File Operation Tracking scenario-file-io-001 | file_io | 5 | high |
| Run ID | Prompt Version | Scenario | Overall Score | Date |
|---|---|---|---|---|
| No runs yet. | ||||