Close Milestone 2 with measured evidence
This commit is contained in:
parent
fb0df5e4a1
commit
4c5773c865
10 changed files with 771 additions and 9 deletions
|
|
@ -583,3 +583,30 @@ compilation, lock and dependency checks, package builds, and all three milestone
|
|||
Three independent final audits approve client publication and policy binding, doctor fail-closed
|
||||
behavior, and benchmark/contract coverage. Clean-revision benchmark evidence is still required
|
||||
before closeout.
|
||||
|
||||
### Milestone 2 closeout
|
||||
|
||||
Candidate commit `fb0df5e4a1c591c2a84788fd4814d98550f11863` passed the clean ten-sample
|
||||
Milestone 2 benchmark. Task-context complete traversal measured 703.561 ms median and 721.847 ms
|
||||
p95 across 11 bounded pages. It reconstructed the exact 1,000-candidate collection from 108 cited
|
||||
evidence records, 891 original token-budget omissions, and one hash-attested response-limit
|
||||
surrogate. Generation-diff complete traversal measured 418.607 ms median and 425.315 ms p95 across
|
||||
10 pages.
|
||||
|
||||
Read and no-AST bootstrap remained below 10 ms p95. The maximum generation page used 199,566 bytes
|
||||
of the 200,000-byte budget and correctly discarded diagnostics before primary evidence.
|
||||
Configuration preview measured about 314 ms median and 365 ms p95 because it proves the real
|
||||
isolated interpreter import on every invocation. Codex and OpenClaw doctor checks remained below
|
||||
0.6 ms p95; Claude remained explicitly degraded because its timeout format is unverified.
|
||||
Isolated-process peak RSS was 86,448 KiB against the 262,144 KiB gate.
|
||||
|
||||
All measured configuration and doctor counters were zero. Task-context pages performed one index
|
||||
check and two cheap generation checks with no loads, parses, synchronization, builds, extraction,
|
||||
rendering, or viewer work. Generation-diff pages performed two cheap generation checks and no
|
||||
index check. The canonical machine-readable result is
|
||||
`benchmarks/milestone2-2026-07-29.json`.
|
||||
|
||||
Milestone 2 is complete. Follow-up ideas stay explicitly later-scope: avoid recomputing the
|
||||
task-shaped capsule for every continuation page, add authenticated continuation when the threat
|
||||
model requires it, verify a native Claude timeout representation, and introduce adapter-owned
|
||||
launcher metadata before generating configurations for custom adapters.
|
||||
|
|
|
|||
Loading…
Add table
Add a link
Reference in a new issue