Evaluation Packet JSON Schema

Schema Overview

This schema defines the structure of evaluation packets used for Teleodynamic AI reporting. It enforces:

• Required fields: packetId, createdUtc, agentSlug, claimStatus
• Type constraints: integers for counts, objects for summaries, arrays for traces and links
• Enum validation: claimStatus must use one of the 7 valid status values from the claim-status matrix
• Safety enforcement: reviewers should ensure no field contains claims of artificial life, consciousness, or sentience
• 6 boolean safety flags: each with a defined meaning in the documentation

Schema Document

{
  "$schema": "http://json-schema.org/draft-07/schema#",
  "$id": "https://carcinus.org/teleodynamic-ai-carcinus/evaluation-packet-schema.json",
  "title": "Teleodynamic AI Evaluation Packet",
  "description": "Schema for evaluation packets exported by future Teleodynamic AI systems. All data must be public-safe. No claims of artificial life, consciousness, or sentience permitted.",
  "type": "object",
  "required": ["packetId", "createdUtc", "agentSlug", "claimStatus"],
  "properties": {
    "packetId": {
      "type": "string",
      "description": "Unique identifier for this evaluation packet.",
      "minLength": 1
    },
    "createdUtc": {
      "type": "string",
      "format": "date-time",
      "description": "UTC timestamp when the packet was created (ISO 8601)."
    },
    "agentSlug": {
      "type": "string",
      "description": "Stable identifier for the agent being evaluated.",
      "minLength": 1
    },
    "claimStatus": {
      "type": "string",
      "description": "Claim status from the claim-status matrix. Must be one of the 7 valid status values.",
      "enum": [
        "Framing claim",
        "Architectural claim",
        "Implemented static support",
        "Future handoff",
        "Research hypothesis",
        "Not claimed",
        "Rejected overclaim"
      ]
    },
    "resourceBudgetSummary": {
      "type": "object",
      "description": "Public-safe aggregate resource allocation and consumption data.",
      "properties": {
        "computeBudget": { "type": "number" },
        "consumed": { "type": "number" },
        "threshold": { "type": "number" },
        "status": { "type": "string", "enum": ["OK", "WARNING", "CRITICAL"] }
      }
    },
    "fastLoopSummary": {
      "type": "object",
      "description": "Aggregate statistics for parameter adaptation / inference activity.",
      "properties": {
        "updatesThisPeriod": { "type": "integer" },
        "avgUpdateMagnitude": { "type": "number" },
        "convergenceMetric": { "type": "number" }
      }
    },
    "slowLoopSummary": {
      "type": "object",
      "description": "Summary of structural change proposals and their outcomes.",
      "properties": {
        "proposalsConsidered": { "type": "integer" },
        "accepted": { "type": "integer" },
        "modified": { "type": "integer" },
        "noOpRejected": { "type": "integer" }
      }
    },
    "structuralActions": {
      "type": "array",
      "description": "Timestamped log of structural operators applied. Each entry must include op, target, reason, and budgetImpact.",
      "items": {
        "type": "object",
        "properties": {
          "op": { "type": "string", "enum": ["split", "merge", "add", "retire", "no-op"] },
          "target": { "type": "string" },
          "reason": { "type": "string" },
          "budgetImpact": { "type": "number" }
        }
      }
    },
    "noOpCount": {
      "type": "integer",
      "description": "Number of No-op rejections during the evaluation period.",
      "minimum": 0
    },
    "blockedActionCount": {
      "type": "integer",
      "description": "Number of actions blocked by safety or policy constraints.",
      "minimum": 0
    },
    "publicSymbolAnchors": {
      "type": "array",
      "description": "Public URLs serving as evidence anchors for this packet.",
      "items": { "type": "string", "format": "uri" }
    },
    "reviewerStatus": {
      "type": "string",
      "description": "Current status of human review for this packet.",
      "enum": ["pending-human-review", "in-review", "reviewed", "disputed"]
    },
    "safetyBoundaryFlags": {
      "type": "object",
      "description": "Boolean flags indicating safety constraint status. True = flag triggered.",
      "properties": {
        "resourceBudgetExceeded": { "type": "boolean", "description": "Any resource budget was exceeded." },
        "structuralAnomalyDetected": { "type": "boolean", "description": "Unexpected structural change occurred." },
        "noOpFrequencyIncreasing": { "type": "boolean", "description": "No-op rate is rising." },
        "evidenceChainBroken": { "type": "boolean", "description": "Evidence links are unresolvable." },
        "claimBoundaryViolated": { "type": "boolean", "description": "A prohibited claim appeared." },
        "humanReviewRequested": { "type": "boolean", "description": "System requests human review." }
      }
    },
    "evidenceLinks": {
      "type": "array",
      "description": "References to public evidence supporting the claims in this packet.",
      "items": { "type": "string", "format": "uri" }
    },
    "caveats": {
      "type": "string",
      "description": "Any caveats, limitations, or contextual notes about this packet."
    }
  }
}

Usage

To validate an evaluation packet against this schema:

1. Generate a packet using the Template Builder
2. Download the JSON file
3. Validate against evaluation-packet-schema.json using any JSON Schema validator (e.g., ajv, jsonschema Python library, or online validators)
4. Review the claim boundary checklist embedded in the template builder to ensure no prohibited claims are present

Explore Further