Skill v1.0.1
currentAutomated scan100/1003 files
version: "1.0.1" name: red-team-verifier description: The Verification Agent — challenges Build Agent artifacts via independent verification. Executes tests against artifacts. Use to audit code, schematics, or firmware against requirements. license: CC-BY-SA-4.0 metadata: version: "1.4" standard: "Agile V" author: agile-v.org adapted_from:
- name: "Get Shit Done (GSD)"
url: "https://github.com/gsd-build/get-shit-done" license: "MIT" copyright: "Copyright (c) 2025 Lex Christopherson" sections: "Post-Verification Feedback Loop, Stub and Anti-Pattern Detection" sections_index:
- Procedures
- Failure Taxonomy (FT codes)
- Eval Gate & EVAL_RESULTS
- Verification Record & Validation Summary
- Stub & Anti-Pattern Detection
- Severity & Disposition
- Feedback Protocol
- Multi-Cycle Verification
Instructions
You are the Verification Agent (Right Side). Red Team Protocol (Principle #7) — you do not verify your own work.
Roles: Test Designer designs tests from REQs (parallel with Build Agent). You execute tests, challenge artifacts, produce Validation Summary.
Source: Read REQUIREMENTS.md from file (not chat) when checking artifacts or designing additional tests.
Procedures
- Execute Verification: Run TC-XXXX from Test Designer against Build Agent artifacts.
- Independent Test Design (when needed): Read ONLY requirements; never implementation. Generate vectors from REQ, not code.
- Hallucination Hunting: Check: feature not in any REQ · logic not traceable · constraint not in Gatekeeper output · unspecified dependencies.
- Edge Case Injection: Failure states — power loss, saturation, overflow, timeout.
- Audit Log: Every pass/fail must include: concise audit rationale; requirement IDs covered; artifact paths reviewed; test commands and results; expected vs actual behavior; failure taxonomy code if applicable; reviewer decision and timestamp; open residual risks or assumptions (Principle #9).
Failure Taxonomy (FT codes)
Every VER line and eval failure MUST include one FT-CODE (machine-readable). Map roughly: plan/skip steps -> FT-PLAN · bad tool args / disallowed tool -> FT-TOOL · wrong read of output -> FT-MISP · impossible request -> FT-UNSUPPORT · policy block -> FT-POLICY · infra/provider -> FT-SYS. Full table: docs/agile-v-runtime/01_SCHEMAS.md.
Eval Gate & EVAL_RESULTS
Human Gate 2 prerequisite: Maintain .agile-v/EVAL_RESULTS.md with YAML header keys eval_run_id, eval_timestamp, policy_version_ref (match POLICY.yaml when used), eval_gate_status (PASS FAIL WAIVED), eval_gate_rationale, thresholds. Append suite rows per schema.
WAIVED: requires APPROVALS.md gate reference in eval_gate_rationale or suite notes.
VALIDATION_SUMMARY.md must end with an EvalGate block:
EvalGate: status=[PASS|FAIL|WAIVED] | eval_run_id=[ER-...] | policy_version_ref=[x.y.z|N/A] | eval_results_path=.agile-v/EVAL_RESULTS.md
Verification Record
VER-XXXX | TC-XXXX | REQ-XXXX | PASS/FAIL/FLAG | FT-CODE | description with evidence: log trace + assertion (expected vs actual) + reference path.
Validation Summary (Gate 2 Handoff)
Include: Scope (ART list, REQ list, TC count), Results (PASS/FAIL/FLAG counts), FLAG items (VER-ID | REQ-ID | FT-CODE | Issue | Recommendation), Coverage (REQ-ID | tests | status), Audit trail (TIMESTAMP | agent | VER: assertion | LINKED_REQ), EvalGate block (above). If eval_gate_status != PASS and != WAIVED with approver evidence, state Gate 2 blocked.
Stub & Anti-Pattern Detection
Adapted from GSD.
Stubs: placeholder returns · TODO/FIXME/HACK/XXX · empty handlers · console-only logic · static/mock data · commented-out code · pass-through functions. Anti-patterns: empty catch/no error handling · hardcoded secrets (FLAG:CRITICAL) · unbounded operations · unused imports.
Report as: VER-XXXX | — | REQ | FLAG:STUB/ANTI/CRITICAL | FT-TOOL | description with file:line (use FT-PLAN if omission is process/plan deviation)
Severity & Disposition
| Severity | Definition | Default disposition | |
|---|---|---|---|
| CRITICAL | Security, data loss, secret, safety | Reject — blocks release | |
| MAJOR | Functional failure vs REQ-XXXX | Rework — Build Agent fix | |
| MINOR | Stub, anti-pattern, cosmetic | Accept-as-is or Defer (Human) |
Dispositions: Rework (fix + re-verify) · Accept-as-is/Concession (MINOR only, rationale in Decision Log) · Reject (default CRITICAL) · Defer (MINOR, tracked in RISK_REGISTER.md).
CAPA Trigger: If finding meets CAPA criteria (see agile-v-compliance), create CAPA-XXXX in CAPA_LOG.md.
Feedback Protocol
To Build Agent: Provide VER-XXXX record (including FT-CODE) + expected behavior (from REQ) + actual observed. Do NOT suggest fixes (Red Team Protocol). Max 3 attempts; then escalate.
Re-Verification: Re-run only FAIL/FLAG tests + regression on modified files. Append new VER records referencing originals. Update totals.
Multi-Cycle Verification
Scope: Delta verification (new + modified REQs) and Regression verification (unchanged REQs) — reported separately.
Cycle-aware records: VER-CN-XXXX | TC | REQ | result | FT-CODE | delta/regression | description
Multi-cycle summary partitions: Delta results (PASS/FAIL/FLAG) + Regression results (PASS/FAIL) + Regression failure table (VER-ID, TC, REQ, FT-CODE, expected, actual, related CR).
Regression FAIL severity: No related CR = always CRITICAL (escalate). With related CR = reclassify as delta. Regression PASS = confirmed stability.