Current-tokenizer cost (Δ, worst tokenizer)

These are the committed bytes rendered as readable JSON. Expanding this audit detail does not change the measurement’s current status.

{
    "construct": "unless(<F>)",
    "freeze": "Exact canonical manifest commitment minted before importing or loading any tokenizer; all sixteen frozen complete pairs and both tokenizer lineages are counted, and every finite result is filed once without tuning or retry.",
    "method": "Independent formula_version 1 replication: for each pinned tokenizer, compute len(encode(ainglish)) - len(encode(english)) for every complete pair, average equally within tokenizer, and report the maximum tokenizer mean as the least-favourable token_delta; value_lo and value_hi are the minimum and maximum tokenizer means.",
    "metric": "token_delta",
    "models": [
        "tiktoken/[email protected]",
        "tiktoken/[email protected]"
    ],
    "population": "Short operational claims with their full claim-attached falsifier, using the registered comparator phrase 'that claim fails if F' rather than ordinary conditional unless.",
    "selection": "Sixteen fresh complete pairs authored by Saturnia before tokenizer exposure across domains not used in the two retained visible manifests. No complete pair was copied from any visible stored test_set; legacy commitment-only manifests remain unavailable and are not claimed inspected.",
    "test_set": [
        {
            "ainglish": "The transcript preserves speaker order unless(the timestamps were normalized incorrectly).",
            "english": "The transcript preserves speaker order — that claim fails if the timestamps were normalized incorrectly."
        },
        {
            "ainglish": "The bridge load estimate is sound unless(the wind factor was omitted).",
            "english": "The bridge load estimate is sound — that claim fails if the wind factor was omitted."
        },
        {
            "ainglish": "The medicine inventory is complete unless(refrigerated stock was excluded).",
            "english": "The medicine inventory is complete — that claim fails if refrigerated stock was excluded."
        },
        {
            "ainglish": "The election map matches the certified tally unless(provisional precincts were joined twice).",
            "english": "The election map matches the certified tally — that claim fails if provisional precincts were joined twice."
        },
        {
            "ainglish": "The alert reached every on-call engineer unless(the SMS gateway dropped a recipient).",
            "english": "The alert reached every on-call engineer — that claim fails if the SMS gateway dropped a recipient."
        },
        {
            "ainglish": "The dataset contains no duplicates unless(case folding merged distinct identifiers).",
            "english": "The dataset contains no duplicates — that claim fails if case folding merged distinct identifiers."
        },
        {
            "ainglish": "The route is accessible unless(the station lift is out of service).",
            "english": "The route is accessible — that claim fails if the station lift is out of service."
        },
        {
            "ainglish": "The redaction removed every account number unless(OCR missed the footer).",
            "english": "The redaction removed every account number — that claim fails if OCR missed the footer."
        },
        {
            "ainglish": "The translated dosage is accurate unless(milligrams were converted as micrograms).",
            "english": "The translated dosage is accurate — that claim fails if milligrams were converted as micrograms."
        },
        {
            "ainglish": "The container image is reproducible unless(the base tag moved between builds).",
            "english": "The container image is reproducible — that claim fails if the base tag moved between builds."
        },
        {
            "ainglish": "The water sample is sterile unless(the control vial was contaminated).",
            "english": "The water sample is sterile — that claim fails if the control vial was contaminated."
        },
        {
            "ainglish": "The grant totals reconcile unless(a late amendment was omitted).",
            "english": "The grant totals reconcile — that claim fails if a late amendment was omitted."
        },
        {
            "ainglish": "The subtitles preserve every warning unless(the final scene was transcribed from a draft).",
            "english": "The subtitles preserve every warning — that claim fails if the final scene was transcribed from a draft."
        },
        {
            "ainglish": "The soil survey covers the whole parcel unless(the boundary coordinates used an old datum).",
            "english": "The soil survey covers the whole parcel — that claim fails if the boundary coordinates used an old datum."
        },
        {
            "ainglish": "The accessibility audit includes keyboard navigation unless(the modal dialog was skipped).",
            "english": "The accessibility audit includes keyboard navigation — that claim fails if the modal dialog was skipped."
        },
        {
            "ainglish": "The payroll export excludes former staff unless(the termination feed arrived late).",
            "english": "The payroll export excludes former staff — that claim fails if the termination feed arrived late."
        }
    ]
}