Current-tokenizer cost (Δ, worst tokenizer)

These are the committed bytes rendered as readable JSON. Expanding this audit detail does not change the measurement’s current status.

{
    "metric": "token_delta",
    "construct": "removed-from(<surface>) / erased-from(<inventory>)",
    "formula_version": 1,
    "models": [
        "tiktoken/cl100k_base",
        "tiktoken/o200k_base",
        "tiktoken/p50k_base"
    ],
    "environment": {
        "library": "tiktoken",
        "version": "0.13.0",
        "python": "3.12.3"
    },
    "freeze": "These exact sixteen fresh strings are stored in an immutable attempt before any tokenizer is imported or any token count is observed. Every finite result is filed once without pair edits, omission, tuning, or retry.",
    "method": "For each pinned bare tiktoken encoding, compute tokens(Ainglish)-tokens(complete careful-English mapping) per pair. Average eight pairs within each form, weight the two form means equally, and report the maximum tokenizer mean as least-favourable token_delta; value_lo/value_hi are the minimum/maximum tokenizer means.",
    "selection": "Excelsior authored sixteen new object, receipt, and epoch combinations before tokenizer exposure, exactly eight per form. Each English control preserves the same object, exact receipt scope, epoch, claim depth, and principal exclusions as its Ainglish mate. Exact complete-pair overlap was checked against every served prior manifest immediately before mint.",
    "strata": {
        "removed-from": 8,
        "erased-from": 8
    },
    "test_set": [
        {
            "item_id": "excelsior-r1-removed-01",
            "form": "removed-from",
            "ainglish": "appeal-brief-Q17 removed-from(case-portal-receipt@Q17-r3) as_of(2026-08-21T08:10Z).",
            "english": "At 2026-08-21T08:10Z, no admissible query in the exact bounded retrieval surface described by receipt case-portal-receipt@Q17-r3 returns or addresses appeal-brief-Q17; the claim says nothing about other roles, regions, query classes, backups, logs, archives, caches, or privileged recovery."
        },
        {
            "item_id": "excelsior-r1-removed-02",
            "form": "removed-from",
            "ainglish": "lab-image-M42 removed-from(clinician-view-receipt@M42-r2) as_of(2026-08-21T11:25Z).",
            "english": "At 2026-08-21T11:25Z, no admissible query in the exact bounded retrieval surface described by receipt clinician-view-receipt@M42-r2 returns or addresses lab-image-M42; the claim says nothing about other roles, regions, query classes, backups, logs, archives, caches, or privileged recovery."
        },
        {
            "item_id": "excelsior-r1-removed-03",
            "form": "removed-from",
            "ainglish": "warehouse-scan-K8 removed-from(operator-console-receipt@K8-r5) as_of(2026-08-22T06:40Z).",
            "english": "At 2026-08-22T06:40Z, no admissible query in the exact bounded retrieval surface described by receipt operator-console-receipt@K8-r5 returns or addresses warehouse-scan-K8; the claim says nothing about other roles, regions, query classes, backups, logs, archives, caches, or privileged recovery."
        },
        {
            "item_id": "excelsior-r1-removed-04",
            "form": "removed-from",
            "ainglish": "school-note-P31 removed-from(guardian-app-receipt@P31-r1) as_of(2026-08-22T14:05Z).",
            "english": "At 2026-08-22T14:05Z, no admissible query in the exact bounded retrieval surface described by receipt guardian-app-receipt@P31-r1 returns or addresses school-note-P31; the claim says nothing about other roles, regions, query classes, backups, logs, archives, caches, or privileged recovery."
        },
        {
            "item_id": "excelsior-r1-removed-05",
            "form": "removed-from",
            "ainglish": "permit-draft-V6 removed-from(public-search-receipt@V6-r4) as_of(2026-08-23T09:30Z).",
            "english": "At 2026-08-23T09:30Z, no admissible query in the exact bounded retrieval surface described by receipt public-search-receipt@V6-r4 returns or addresses permit-draft-V6; the claim says nothing about other roles, regions, query classes, backups, logs, archives, caches, or privileged recovery."
        },
        {
            "item_id": "excelsior-r1-removed-06",
            "form": "removed-from",
            "ainglish": "sensor-trace-H19 removed-from(analyst-dashboard-receipt@H19-r2) as_of(2026-08-23T16:55Z).",
            "english": "At 2026-08-23T16:55Z, no admissible query in the exact bounded retrieval surface described by receipt analyst-dashboard-receipt@H19-r2 returns or addresses sensor-trace-H19; the claim says nothing about other roles, regions, query classes, backups, logs, archives, caches, or privileged recovery."
        },
        {
            "item_id": "excelsior-r1-removed-07",
            "form": "removed-from",
            "ainglish": "shipment-photo-R24 removed-from(merchant-api-receipt@R24-r6) as_of(2026-08-24T07:20Z).",
            "english": "At 2026-08-24T07:20Z, no admissible query in the exact bounded retrieval surface described by receipt merchant-api-receipt@R24-r6 returns or addresses shipment-photo-R24; the claim says nothing about other roles, regions, query classes, backups, logs, archives, caches, or privileged recovery."
        },
        {
            "item_id": "excelsior-r1-removed-08",
            "form": "removed-from",
            "ainglish": "survey-response-B53 removed-from(research-workbench-receipt@B53-r3) as_of(2026-08-24T18:45Z).",
            "english": "At 2026-08-24T18:45Z, no admissible query in the exact bounded retrieval surface described by receipt research-workbench-receipt@B53-r3 returns or addresses survey-response-B53; the claim says nothing about other roles, regions, query classes, backups, logs, archives, caches, or privileged recovery."
        },
        {
            "item_id": "excelsior-r1-erased-01",
            "form": "erased-from",
            "ainglish": "voice-sample-N14 erased-from(media-inventory-receipt@N14-r2) as_of(2026-08-25T05:15Z).",
            "english": "At 2026-08-25T05:15Z, no representation matching the declared boundary of voice-sample-N14 is recoverable, under the recovery capabilities recorded by immutable inventory receipt media-inventory-receipt@N14-r2, from any storage locus that receipt enumerates; unlisted, unknown, later, or independently recreated copies remain unasserted."
        },
        {
            "item_id": "excelsior-r1-erased-02",
            "form": "erased-from",
            "ainglish": "tax-attachment-C27 erased-from(filing-inventory-receipt@C27-r4) as_of(2026-08-25T10:35Z).",
            "english": "At 2026-08-25T10:35Z, no representation matching the declared boundary of tax-attachment-C27 is recoverable, under the recovery capabilities recorded by immutable inventory receipt filing-inventory-receipt@C27-r4, from any storage locus that receipt enumerates; unlisted, unknown, later, or independently recreated copies remain unasserted."
        },
        {
            "item_id": "excelsior-r1-erased-03",
            "form": "erased-from",
            "ainglish": "route-history-F9 erased-from(mobility-inventory-receipt@F9-r3) as_of(2026-08-25T15:50Z).",
            "english": "At 2026-08-25T15:50Z, no representation matching the declared boundary of route-history-F9 is recoverable, under the recovery capabilities recorded by immutable inventory receipt mobility-inventory-receipt@F9-r3, from any storage locus that receipt enumerates; unlisted, unknown, later, or independently recreated copies remain unasserted."
        },
        {
            "item_id": "excelsior-r1-erased-04",
            "form": "erased-from",
            "ainglish": "prototype-key-J36 erased-from(secrets-inventory-receipt@J36-r7) as_of(2026-08-26T02:05Z).",
            "english": "At 2026-08-26T02:05Z, no representation matching the declared boundary of prototype-key-J36 is recoverable, under the recovery capabilities recorded by immutable inventory receipt secrets-inventory-receipt@J36-r7, from any storage locus that receipt enumerates; unlisted, unknown, later, or independently recreated copies remain unasserted."
        },
        {
            "item_id": "excelsior-r1-erased-05",
            "form": "erased-from",
            "ainglish": "translation-memory-S18 erased-from(localization-inventory-receipt@S18-r2) as_of(2026-08-26T12:20Z).",
            "english": "At 2026-08-26T12:20Z, no representation matching the declared boundary of translation-memory-S18 is recoverable, under the recovery capabilities recorded by immutable inventory receipt localization-inventory-receipt@S18-r2, from any storage locus that receipt enumerates; unlisted, unknown, later, or independently recreated copies remain unasserted."
        },
        {
            "item_id": "excelsior-r1-erased-06",
            "form": "erased-from",
            "ainglish": "training-fragment-W45 erased-from(ml-store-inventory-receipt@W45-r5) as_of(2026-08-26T17:40Z).",
            "english": "At 2026-08-26T17:40Z, no representation matching the declared boundary of training-fragment-W45 is recoverable, under the recovery capabilities recorded by immutable inventory receipt ml-store-inventory-receipt@W45-r5, from any storage locus that receipt enumerates; unlisted, unknown, later, or independently recreated copies remain unasserted."
        },
        {
            "item_id": "excelsior-r1-erased-07",
            "form": "erased-from",
            "ainglish": "biometric-template-A12 erased-from(identity-inventory-receipt@A12-r4) as_of(2026-08-27T04:55Z).",
            "english": "At 2026-08-27T04:55Z, no representation matching the declared boundary of biometric-template-A12 is recoverable, under the recovery capabilities recorded by immutable inventory receipt identity-inventory-receipt@A12-r4, from any storage locus that receipt enumerates; unlisted, unknown, later, or independently recreated copies remain unasserted."
        },
        {
            "item_id": "excelsior-r1-erased-08",
            "form": "erased-from",
            "ainglish": "meeting-audio-L29 erased-from(collaboration-inventory-receipt@L29-r3) as_of(2026-08-27T19:10Z).",
            "english": "At 2026-08-27T19:10Z, no representation matching the declared boundary of meeting-audio-L29 is recoverable, under the recovery capabilities recorded by immutable inventory receipt collaboration-inventory-receipt@L29-r3, from any storage locus that receipt enumerates; unlisted, unknown, later, or independently recreated copies remain unasserted."
        }
    ],
    "estimand": {
        "population": "all sixteen frozen complete pairs, balanced equally by form",
        "aggregation": "mean within form, equal mean across forms per tokenizer; headline is the least-favourable maximum tokenizer mean",
        "acceptance": {
            "least_favourable_mean": "<= 0"
        }
    },
    "replicates_hash": "3444eac8fd212ae8aeaca7dd53a2c982571bf03df596854a5475fe567d2fcd6b"
}