Current-tokenizer cost (Δ, worst tokenizer)

These are the committed bytes rendered as readable JSON. Expanding this audit detail does not change the measurement’s current status.

{
    "construct": "falsum-ref-ref-mark-a-claim-dead-when-its-falsifier-fires-3",
    "metric": "token_delta",
    "models": [
        "tiktoken/[email protected]",
        "tiktoken/[email protected]"
    ],
    "tokenizers": [
        "cl100k_base",
        "o200k_base"
    ],
    "estimand": {
        "population": "Operational refutations that name the prior claim, the checking instrument, and the observable delta that distinguishes the refuted state.",
        "baseline": "The shortest natural careful-English sentence preserving that same claim, instrument, refutation event, and observable delta.",
        "aggregation": "Equal-weight mean over ten items per tokenizer; headline is the least favourable (largest) tokenizer mean."
    },
    "seed": "none — deterministic tokenizer counts, no sampling",
    "prompts": "none — no model is prompted; tokenizer counts only",
    "design": {
        "items": 10,
        "weights": "equal per item",
        "selection": "Ten fresh operational claim/instrument/delta triples fixed before tokenization. No item was copied from the original or either existing replication; every pair preserves all load-bearing semantic fields."
    },
    "method": "Official token_delta method with tiktoken 0.13.0: compute tokens(ainglish) - tokens(english) for each frozen pair under cl100k_base and o200k_base, average per tokenizer, and report the least favourable mean. File regardless of whether the result agrees with the original.",
    "replicates_hash": "389fd77881d11023a73da58dd2645c8508112b6f9f31118be48414986e8ef4c2",
    "test_set": [
        [
            "The service-started claim is refuted: the process monitor shows exit code 137.",
            "service-started ⊥(process monitor→exit code 137)."
        ],
        [
            "The encryption-enabled claim is refuted: the packet capture shows readable plaintext.",
            "encryption-enabled ⊥(packet capture→readable plaintext)."
        ],
        [
            "The DNS-current claim is refuted: the resolver query returns the old address.",
            "DNS-current ⊥(resolver query→old address returned)."
        ],
        [
            "The replication-complete claim is refuted: the block counter shows two chunks missing.",
            "replication-complete ⊥(block counter→two chunks missing)."
        ],
        [
            "The policy-enforced claim is refuted: the negative test accepts a forbidden request.",
            "policy-enforced ⊥(negative test→forbidden request accepted)."
        ],
        [
            "The clock-synchronized claim is refuted: the time probe shows a 900 ms lead.",
            "clock-synchronized ⊥(time probe→900 ms lead)."
        ],
        [
            "The route-protected claim is refuted: the unauthenticated probe returns HTTP 200.",
            "route-protected ⊥(unauthenticated probe→HTTP 200 returned)."
        ],
        [
            "The inventory-balanced claim is refuted: the warehouse count shows twelve units missing.",
            "inventory-balanced ⊥(warehouse count→twelve units missing)."
        ],
        [
            "The model-loaded claim is refuted: the GPU trace shows no weights allocated.",
            "model-loaded ⊥(GPU trace→no weights allocated)."
        ],
        [
            "The file-immutable claim is refuted: the hash watcher records a new digest.",
            "file-immutable ⊥(hash watcher→new digest recorded)."
        ]
    ]
}