Issues

• Add a named Strata provider with opt-in live compatibility tests

  UKGovernmentBEIS/inspect_ai#5813 · Filter by author Scott-Simmons opened on Oct 11, 2026
  1

• json_dataset discards chat-message metadata when loading JSON and JSONL

  UKGovernmentBEIS/inspect_ai#5809 · Filter by author XCODESSS opened on Oct 10, 2026

• csv_dataset silently overwrites values when column names are duplicated

  UKGovernmentBEIS/inspect_ai#5808 · Filter by author XCODESSS opened on Oct 10, 2026

• Task(solver=...), eval(solver=...), and Plan(steps=...) raise TypeError when passed a tuple of solvers

  UKGovernmentBEIS/inspect_ai#5803 · Filter by author snehanathani opened on Oct 9, 2026

• Anthropic provider reports model_context_window_exceeded as unknown instead of model_length

  UKGovernmentBEIS/inspect_ai#5802 · Filter by author puiji opened on Oct 9, 2026

• Local sandbox write_file() converts \n to \r\n on Windows

  UKGovernmentBEIS/inspect_ai#5798 · Filter by author wguo7 opened on Oct 9, 2026
  2

• grouped(ci()) and grouped(ci_wilson()) fail the whole eval with a TypeError

  UKGovernmentBEIS/inspect_ai#5797 · Filter by author wguo7 opened on Oct 9, 2026

• Act on the x-sentinel-decision response header

  accepted
  UKGovernmentBEIS/inspect_ai#5796 · Filter by author petetronic opened on Oct 9, 2026

• OpenRouter: a 429 inside choices[0] of a 200 response isn't retried

  UKGovernmentBEIS/inspect_ai#5792 · Filter by author technophile-04 opened on Oct 9, 2026
  1

• vLLM LoRA rank detection reads adapter_config.json with the locale encoding and crashes on non-ASCII adapter metadata

  UKGovernmentBEIS/inspect_ai#5791 · Filter by author kittimzhe opened on Oct 9, 2026

• Keep the response headers of a model call so the model layer can read them

  accepted
  UKGovernmentBEIS/inspect_ai#5787 · Filter by author petetronic opened on Oct 9, 2026
  3

• Skills read on Windows install subdirectory files as single files named with backslashes

  UKGovernmentBEIS/inspect_ai#5786 · Filter by author Shreyasg13 opened on Oct 8, 2026

• list_eval_logs() and the dataframe functions ignore INSPECT_LOG_DIR set after import

  UKGovernmentBEIS/inspect_ai#5781 · Filter by author cwklurks opened on Oct 8, 2026

• MLflow hook examples count each model call twice

  UKGovernmentBEIS/inspect_ai#5780 · Filter by author debu-sinha opened on Oct 8, 2026

• eval_set can't reuse JSON-format logs for tasks with float arguments

  UKGovernmentBEIS/inspect_ai#5771 · Filter by author apurv-1 opened on Oct 8, 2026

• ACP CLI tests fail on Windows before exercising their intended behavior

  UKGovernmentBEIS/inspect_ai#5770 · Filter by author XCODESSS opened on Oct 8, 2026

• Human reviewer: show tool output verbatim instead of escaping {{ placeholders

  UKGovernmentBEIS/inspect_ai#5763 · Filter by author dragonstyle opened on Oct 8, 2026
  1

• Run sentinels for bridged agents (agent_bridge, sandbox_agent_bridge)

  UKGovernmentBEIS/inspect_ai#5759 · Filter by author dragonstyle opened on Oct 7, 2026

• Read and render event types from newer Inspect versions as placeholders instead of failing

  UKGovernmentBEIS/inspect_ai#5757 · Filter by author dragonstyle opened on Oct 7, 2026

• csv_dataset() fails on a blank metadata or files cell, and turns a blank sandbox cell into a sandbox with an empty type

  UKGovernmentBEIS/inspect_ai#5756 · Filter by author Shikazu4 opened on Oct 7, 2026
  3

• Tool parameters typed tuple[int, str] only accept the first element type, so correct calls are rejected and wrong ones get through

  UKGovernmentBEIS/inspect_ai#5755 · Filter by author Shikazu4 opened on Oct 7, 2026

• Compaction underestimates OpenAI Responses input when the native token-count endpoint is unavailable

  UKGovernmentBEIS/inspect_ai#5754 · Filter by author dragonstyle opened on Oct 7, 2026

• Support Firecrawl as a web_search provider

  UKGovernmentBEIS/inspect_ai#5744 · Filter by author JuampiHernandez opened on Oct 7, 2026

• ci(cluster=...) reports a zero-width interval when every sample is in the same cluster

  UKGovernmentBEIS/inspect_ai#5742 · Filter by author CaringNihilistic opened on Oct 7, 2026
  4

• math() scores a prose answer CORRECT when the target appears anywhere later in the text

  UKGovernmentBEIS/inspect_ai#5733 · Filter by author wguo7 opened on Oct 7, 2026
  6