Repository navigation
Strengthen verification evidence and native context checks - #64
Conversation
Signed-off-by: Kent Huang <kent@infuseai.io>
Independent AI review — round 1Base and working-tree HEAD:
Parent verification: focused evidence/provenance/boundary tests and real non-model native canaries. Subsequent complete verification and re-review are recorded separately. These are independent AI-subagent findings, not human or GitHub approval submissions. |
Independent AI review — round 2Base: Standards: APPROVE. Specification: APPROVE. Both independently reviewed the entire 21-file scope, not just the fixes. No remaining material findings, decisions or optional suggestions. Both confirmed the two round-1 P1 corrections, configuration validation ordering, private provenance handling, bounded artifact evidence and shared eligibility filtering. Scope audit: ownership remains handoff/journey, Behavior Diff/comparison, existing runner/execution. No new orchestration database, alternative model executor, automatic custom fallback, credential copying or Full Access. Added deterministic tests and canonical documentation remain in scope. Parent verification passed: full repository deterministic suite; whole-repository Ruff and shfmt; Python syntax; patch whitespace; complete hooks/runner suite under Bash 3.2; actual native config/access canaries; saved-file and native-record API smokes. Actual runner + synthetic malformed native stream exited nonzero, retained unavailable boundary status and emitted zero assessment records. No model call. Limits: no fresh paid model journey; filesystem enforcement does not prove all-context isolation; unavailable per-turn model/history provenance remains unavailable. Review approval does not authorize merge. These are independent AI reviews, not human approvals. |
Post-review finding — CI policy correctionPublished head: A subsequent policy check found that the new native-boundary test suite included a local runner smoke. The CI step would invoke Disposition: confirmed in-scope defect, correction pending verification and independent re-review. The current CI run received a cancellation request. The local correction skips this runner smoke whenever CI is set; deterministic module tests remain enabled. No model invocation occurred in the exercised smoke. Earlier approval does not close this new finding. The correction will be verified and reviewed before publication; no merge is authorized. |
Signed-off-by: Kent Huang <kent@infuseai.io>
Independent AI review — round 3 and published correctionBase: Standards: APPROVE. Specification: APPROVE. Both independent AI reviewers re-read the complete staged scope. No material findings, decisions or optional suggestions remain. The post-review CI defect is fixed and verified: the workflow sets CI=1 and the runner-smoke decorator skips before its body executes. Module-level boundary tests remain enabled. The runner smoke remains local-only. The superseded CI run is confirmed canceled; the new head's CI result will be recorded separately. Parent checks for this correction: CI=1 native-boundary suite ran 12 tests with the one local-only smoke skipped; the targeted actual-runner smoke passed outside CI; Ruff passed. Prior full-suite and runtime evidence applies to unchanged production code. An additional real native non-model check also denied access to a file in an enclosing Git repository outside a nested trial workspace. Scope audit: bounded artifact evidence, optional native filesystem checks, private preparer provenance and deterministic regressions stay within existing responsibilities. No new executor/database, automatic Full Access, credential copying, paid model run, or automatic fallback. Prior Bash 3.2 and premature-marker fixes remain intact. No permanent mechanism was removed. Limits remain explicit: this is not a new paid end-to-end journey; filesystem enforcement is not full-context isolation; resolved per-turn model and historical context provenance remain unavailable where the native host cannot establish them. Both commits carry DCO sign-offs. No merge performed or authorized. |
Final verificationPublished head CI run 40817945121 completed successfully: Format — success; Unit — success. The earlier run remains canceled and is not counted as successful verification. All review findings are resolved; the final complete-scope standards and specification reviews both approve. No paid model journey, release or merge performed. |
What changes
Follow-up to #63, preserving the ownership model: the handoff owns the journey, Behavior Diff owns comparison, and the existing runner owns execution.
Updates canonical preparation guidance, architecture/flow documentation, deterministic regressions and existing CI wiring. No new orchestration database or model executor.
Verification
run-trial.shsmoke with real native preflight and a synthetic malformed event stream: nonzero exit, boundary still unavailable, zero assessment records. No model invoked.Limits
This is not a fresh paid end-to-end model journey. Native filesystem enforcement does not prove isolation from injected instructions, connectors, browser/cloud state or every other context channel. Lack of an observed attempt is not proof of clean context. Captured artifacts do not prove authorship or real external actions. Native exports do not authenticate themselves or prove the resolved execution model.
No live/paid model run, release, or merge performed. This PR does not touch the instruction-file paths that trigger the paid dogfood workflow.
Reviewed commit:
5808dbe9bd538ce4e806f7e9c237a5bb5e53bc04Reviewed tree:
d16cd5ecd5afc1fb5b9afea592e666dac9577708Base:
7839bd02bdb8ced4733c2f9884547ecaac2e5637DCO sign-off included.