Current integration-failure profile · 2026-08-28
Current cross-harness integration-failure profile
Verdict: 4/4 receipts verified; 0 valid comparable task outcomes. This is an integration-failure profile, not market performance and not a quality ranking.
Codex direct and Flywheel on Codex received byte-identical task prompts and byte-identical role-neutral runtime contexts for each task. The four durations below are diagnostic only because no attempt completed with an oracle pass.
| Route and task | Duration | Execution | Oracle | Receipt | Exact result |
|---|---|---|---|---|---|
| Codex direct agt-001-index-fallback-integrity | 35,357 ms | returned | fail | verified | Admitted artifact. Oracle rejected failure_classes_mismatch: the provider emitted degraded_match; the fixture contract requires degraded_match_behavior. |
| Codex direct agt-003-codex-flywheel-shared-task | 5,664 ms | internal_error | not_run | verified | Codex turn failed after one successful staged-file discovery command. The models cache could not load because base_instructions was missing at line 97 column 5. |
| Flywheel on Codex agt-001-index-fallback-integrity | 2,028 ms | malformed | not_run | verified | Inner Codex emitted turn.failed. Flywheel recorded final agent message missing and preserved its ledger entry and verified checkpoint. |
| Flywheel on Codex agt-003-codex-flywheel-shared-task | 2,043 ms | malformed | not_run | verified | Inner Codex emitted turn.failed. Flywheel recorded final agent message missing and preserved its ledger entry and verified checkpoint. |
Byte-identical prompt and context parity
| Task | Prompt SHA-256 and bytes | Runtime context SHA-256 and bytes | Equal across routes |
|---|---|---|---|
| agt-001-index-fallback-integrity | b454eacba05930001108b80b6d1d881ad02529c95dfd5d6579e7c1aba9231ca82,098 bytes | 09b571dc3be8a011321bae35b1fc677136eff49684f90658b371c6bab703f574992 bytes | yes |
| agt-003-codex-flywheel-shared-task | 4f47fc123a8c7a5cce359d5a401dabbc747590aff103f15ec933f5802bda53062,124 bytes | f34d5f28f592f465a4bd65a22ab24b0443f00c49497104577d0fb0b60557eb6f1,046 bytes | yes |
- Benchmark code
09f4d3730f5f81d88b0aba130a1067979d0a7d07- Public result source
- Sanitized source record ·
8061c0b9c13ed088e1265f419e895447f36803b561f262e9f0a79b6689dc9cdd - Evidence availability
- operator-local-hash-only; raw attempt artifacts remain private and are represented here by hashes and sanitized receipt records.
- Requested model
- gpt-5.3-codex-spark
- Observed model identity
- Unknown: requested registry reference was not provider-observed
- Cost
- Unknown: provider cost unavailable
- Resource use
- Unknown: CPU, memory, GPU, and energy observations unavailable
Sanitized receipt records
| Route and task | State | Receipt SHA-256 | Subject SHA-256 |
|---|---|---|---|
| Codex direct agt-001-index-fallback-integrity | verified | dc6531acf514618bf6d8934594bf9c621345f2a5216ed5bd86f9b3add7a8cc7d | cf5b394a8d19e274d77813e06736910e05b3ef5e4e3758f470cff32d601e3da3 |
| Codex direct agt-003-codex-flywheel-shared-task | verified | 9853c9d91b326ed375561c064c043568de79a68cf66aebdd57bb64ab3aedf3d1 | e8ded713b279e8e8df4d516529c5f9f4a00428a5b3f765964fa93086dd0cfd4d |
| Flywheel on Codex agt-001-index-fallback-integrity | verified | 58d0dfbac97b4bcb9edf3c921a148ca011c980a20b595d294b4f08c4a2259a41 | 087ccca3187ad495e7834d97d332e651f91284be47f2879dd0595115e7462d5d |
| Flywheel on Codex agt-003-codex-flywheel-shared-task | verified | 804dabeaa888dfa13dd097c32c4fcda38a11cbda5903cfd48955df9bf3363d1a | 73b93fa47088434fc20667257f84e12e9dc28b6689b50ef9564051243337eaa2 |
Artifact hashes
| Artifact | SHA-256 |
|---|---|
| manifest | dca3f8205bea82e324902f3dc23ecefe26bbd1f776522e5d0185471797536772 |
| runtimeMatrix | c06295254b4246bc99395faec97a875e4f998b47c3cf9f3cd1166bec0db67c9f |
| runRecord | 957041f72162c52f9951fd7291f89e70758e9696794aab26e4ddc57645c93e01 |
| comparisonInput | 1a48bee1e1ee9cd13c44c58baa474881cd7a2197b10fea65779f55db845e8f79 |
| artifactIndex | 0ec72ad56bf12f54f3ba63165c9f945795153e34c514edfeae081fc2544ecca5 |
Limitations
- One repetition per cell is an admission pilot, not a performance distribution.
- No attempt completed with an oracle pass, so latency is diagnostic only and must not be ranked as speed.
- Usage, cost, CPU, memory, GPU, and energy observations are unavailable.
- Model identity is requested but not provider-observed.
- Claude Code, OpenCode, Aider, and local model routes are not measured in this pilot.
- Raw run artifacts remain operator-local; the public record exposes sanitized outcomes and immutable hashes only.
What this does not prove: This integration-failure profile does not establish market performance, a quality ranking, speed, production reliability, harness attribution, or provider-observed model identity.