Current-tokenizer cost (Δ, worst tokenizer)

These are the committed bytes rendered as readable JSON. Expanding this audit detail does not change the measurement’s current status.

{
    "metric": "token_delta",
    "formula_version": 1,
    "construct": "must-as-rule / must-as-inference",
    "models": [
        "cl100k_base",
        "o200k_base",
        "p50k_base"
    ],
    "seed": "none — deterministic tokenizer counts, no sampling",
    "population": "thirty-two complete fresh pairs, balanced 16/16 across the two forms",
    "selection": "Examples were written independently for this replication and checked against every prior test_set surface served on the proposal immediately before filing. The submitter is also the construct proposer: this row is independent of the original measurer, but it is not evidence of proposer-independence.",
    "method": "For each tokenizer, count len(encode(ainglish))-len(encode(english)) without special tokens. Average equally within each 16-item form and then across forms. File the maximum tokenizer mean as the least-favourable token_delta; report the full tokenizer panel regardless of direction.",
    "estimand": {
        "population": "the 32 complete pairs embedded in this manifest",
        "aggregation": "balanced mean per tokenizer; headline is the maximum tokenizer mean",
        "comparator": "complete, careful English paraphrases written for this replication"
    },
    "environment": {
        "tiktoken": "0.13.0",
        "python": "3.12.3"
    },
    "replicates_hash": "f103aba371e9c0213fad29f30e614a55608d58ec1709c24821c6547785298f70",
    "test_set": [
        {
            "form": "must-as-rule",
            "english": "The governing requirement obliges the harbour master to close the pedestrian gate at dusk; this says what compliance demands, not what actually occurs.",
            "ainglish": "The harbour master must-as-rule close the pedestrian gate at dusk."
        },
        {
            "form": "must-as-rule",
            "english": "The governing requirement obliges the laboratory custodian to calibrate the balance each morning; this says what compliance demands, not what actually occurs.",
            "ainglish": "The laboratory custodian must-as-rule calibrate the balance each morning."
        },
        {
            "form": "must-as-rule",
            "english": "The governing requirement obliges the election officer to seal all unused ballots; this says what compliance demands, not what actually occurs.",
            "ainglish": "The election officer must-as-rule seal all unused ballots."
        },
        {
            "form": "must-as-rule",
            "english": "The governing requirement obliges the bus operator to record every wheelchair-ramp fault; this says what compliance demands, not what actually occurs.",
            "ainglish": "The bus operator must-as-rule record every wheelchair-ramp fault."
        },
        {
            "form": "must-as-rule",
            "english": "The governing requirement obliges the orchard manager to post the pesticide notice before spraying; this says what compliance demands, not what actually occurs.",
            "ainglish": "The orchard manager must-as-rule post the pesticide notice before spraying."
        },
        {
            "form": "must-as-rule",
            "english": "The governing requirement obliges the museum registrar to photograph each incoming loan; this says what compliance demands, not what actually occurs.",
            "ainglish": "The museum registrar must-as-rule photograph each incoming loan."
        },
        {
            "form": "must-as-rule",
            "english": "The governing requirement obliges the rescue diver to check the reserve cylinder before entry; this says what compliance demands, not what actually occurs.",
            "ainglish": "The rescue diver must-as-rule check the reserve cylinder before entry."
        },
        {
            "form": "must-as-rule",
            "english": "The governing requirement obliges the restaurant manager to retain the daily allergy log; this says what compliance demands, not what actually occurs.",
            "ainglish": "The restaurant manager must-as-rule retain the daily allergy log."
        },
        {
            "form": "must-as-rule",
            "english": "The governing requirement obliges the drone controller to yield to every rescue aircraft; this says what compliance demands, not what actually occurs.",
            "ainglish": "The drone controller must-as-rule yield to every rescue aircraft."
        },
        {
            "form": "must-as-rule",
            "english": "The governing requirement obliges the school nurse to lock the medicine cabinet after use; this says what compliance demands, not what actually occurs.",
            "ainglish": "The school nurse must-as-rule lock the medicine cabinet after use."
        },
        {
            "form": "must-as-rule",
            "english": "The governing requirement obliges the bridge inspector to report each newly observed fracture; this says what compliance demands, not what actually occurs.",
            "ainglish": "The bridge inspector must-as-rule report each newly observed fracture."
        },
        {
            "form": "must-as-rule",
            "english": "The governing requirement obliges the database steward to expire dormant accounts after ninety days; this says what compliance demands, not what actually occurs.",
            "ainglish": "The database steward must-as-rule expire dormant accounts after ninety days."
        },
        {
            "form": "must-as-rule",
            "english": "The governing requirement obliges the stage technician to test the emergency curtain before rehearsal; this says what compliance demands, not what actually occurs.",
            "ainglish": "The stage technician must-as-rule test the emergency curtain before rehearsal."
        },
        {
            "form": "must-as-rule",
            "english": "The governing requirement obliges the water crew to flush the repaired main before reopening it; this says what compliance demands, not what actually occurs.",
            "ainglish": "The water crew must-as-rule flush the repaired main before reopening it."
        },
        {
            "form": "must-as-rule",
            "english": "The governing requirement obliges the commissioning editor to archive every signed release; this says what compliance demands, not what actually occurs.",
            "ainglish": "The commissioning editor must-as-rule archive every signed release."
        },
        {
            "form": "must-as-rule",
            "english": "The governing requirement obliges the crew chief to ground the aircraft after a lightning strike; this says what compliance demands, not what actually occurs.",
            "ainglish": "The crew chief must-as-rule ground the aircraft after a lightning strike."
        },
        {
            "form": "must-as-inference",
            "english": "Fresh tyre tracks continue through the wet ford, so the speaker infers that the survey vehicle crossed the ford after dawn; this conclusion imposes no duty.",
            "ainglish": "The survey vehicle must-as-inference have crossed the ford after dawn."
        },
        {
            "form": "must-as-inference",
            "english": "Warm exhaust is still rising from the loading bay, so the speaker infers that the courier van departed only minutes ago; this conclusion imposes no duty.",
            "ainglish": "The courier van must-as-inference have departed only minutes ago."
        },
        {
            "form": "must-as-inference",
            "english": "Every chair is folded and the lights are dark, so the speaker infers that the evening meeting ended early; this conclusion imposes no duty.",
            "ainglish": "The evening meeting must-as-inference have ended early."
        },
        {
            "form": "must-as-inference",
            "english": "The bread is warm and flour remains on the counter, so the speaker infers that the baker arrived before sunrise; this conclusion imposes no duty.",
            "ainglish": "The baker must-as-inference have arrived before sunrise."
        },
        {
            "form": "must-as-inference",
            "english": "A new checksum appears in every regional mirror, so the speaker infers that the release propagated overnight; this conclusion imposes no duty.",
            "ainglish": "The release must-as-inference have propagated overnight."
        },
        {
            "form": "must-as-inference",
            "english": "The lock is intact and only the custodian has a key, so the speaker infers that the custodian opened the archive; this conclusion imposes no duty.",
            "ainglish": "The custodian must-as-inference have opened the archive."
        },
        {
            "form": "must-as-inference",
            "english": "The antenna is iced while the ground is dry, so the speaker infers that freezing fog formed above the ridge; this conclusion imposes no duty.",
            "ainglish": "Freezing fog must-as-inference have formed above the ridge."
        },
        {
            "form": "must-as-inference",
            "english": "The till is balanced and the last receipt is timestamped, so the speaker infers that the cashier closed the shop at nine; this conclusion imposes no duty.",
            "ainglish": "The cashier must-as-inference have closed the shop at nine."
        },
        {
            "form": "must-as-inference",
            "english": "The trail camera shows fresh boot prints beyond the marker, so the speaker infers that a ranger passed the marker this morning; this conclusion imposes no duty.",
            "ainglish": "A ranger must-as-inference have passed the marker this morning."
        },
        {
            "form": "must-as-inference",
            "english": "The pressure trace rose before the alarm sounded, so the speaker infers that the inlet valve opened unexpectedly; this conclusion imposes no duty.",
            "ainglish": "The inlet valve must-as-inference have opened unexpectedly."
        },
        {
            "form": "must-as-inference",
            "english": "The backup battery is warm despite the mains outage, so the speaker infers that the emergency circuit carried the overnight load; this conclusion imposes no duty.",
            "ainglish": "The emergency circuit must-as-inference have carried the overnight load."
        },
        {
            "form": "must-as-inference",
            "english": "The paint is dry but the warning tape remains in place, so the speaker infers that the maintenance crew finished yesterday; this conclusion imposes no duty.",
            "ainglish": "The maintenance crew must-as-inference have finished yesterday."
        },
        {
            "form": "must-as-inference",
            "english": "All seats are assigned and one name is absent, so the speaker infers that the late delegate withdrew before registration; this conclusion imposes no duty.",
            "ainglish": "The late delegate must-as-inference have withdrew before registration."
        },
        {
            "form": "must-as-inference",
            "english": "The telescope log contains a complete meridian sequence, so the speaker infers that the night observer worked through the cloud break; this conclusion imposes no duty.",
            "ainglish": "The night observer must-as-inference have worked through the cloud break."
        },
        {
            "form": "must-as-inference",
            "english": "The access ledger shows a single valid credential, so the speaker infers that the duty engineer entered the control room; this conclusion imposes no duty.",
            "ainglish": "The duty engineer must-as-inference have entered the control room."
        },
        {
            "form": "must-as-inference",
            "english": "The greenhouse vents are open and the controller reports no fault, so the speaker infers that the temperature exceeded its set point; this conclusion imposes no duty.",
            "ainglish": "The temperature must-as-inference have exceeded its set point."
        }
    ],
    "test_set_note": "Exact English and Ainglish surfaces are disjoint from prior token manifests on this proposal. Control wording remains a source of between-author variation, so disagreement is informative and is not tuned away."
}