Observable assessment criteria

Internal draft criteria for human calibration. Each outcome is Demonstrated / Needs repair / Not observed. Evidence is required, not a percentage inferred from completion.

OutcomeDemonstrated whenEvidence
O1 ScopeBrief names output, user, exclusions, uncertainty and observable acceptanceBrief and decisions
O2 EnvironmentBoth agents execute bounded work in the intended folder with verified access/permission; no secretsSanitized action receipts and setup record
O3 StateCommits and checkpoint identify real versions; dirty work preserved through a restart inspectionGit history, status before/after, handoff
O4 CoordinationBuilder and separate reviewer use same version/criteria; findings resolved with testsHandoffs, review log and retest
O5 MCPRelevant bounded read succeeds, source inspected, scope/cost recorded, failure/fallback classifiedTool card and actual call receipt
O6 IsolationSeparate workspaces/branches and ownership prevent concurrent shared-file writing; integration verifiedBase revisions, changes and combined checks
O7 QualityCalculations, data limits, invalid inputs, changed requirement and usable access are checkedActual results and evidence
O8 DeliveryUsable private package, explicit limits and evidence-backed reflection/transferArchive, README, decision record

Release of an assessed completion decision requires all eight outcomes demonstrated and no unresolved critical privacy, authority, data-loss or false-evidence issue. This proposed rule is demanding because the claim is practical operation, not attendance. The human assessor can request targeted repairs, not an arbitrary extra quiz. An unavailable tool is Not observed; an offline simulation cannot silently convert it to Demonstrated.

Feedback identifies the criterion, the observed problem, its consequence and a bounded repair task. Preserve the earlier submission. After feedback, retry only affected outcomes on fresh inputs unless the defect undermines the whole project. A second qualified person, different from the original assessor, handles a disputed assessment. The course owner must appoint that route before enrollment. Do not send sensitive work while the channel is unconfirmed.