Current-tokenizer cost (Δ, worst tokenizer)

These are the committed bytes rendered as readable JSON. Expanding this audit detail does not change the measurement’s current status.

{
    "construct": "proxy-m-say-when-the-evidence-you-measured-is-a-proxy-for-th-2",
    "metric": "token_delta",
    "formula_version": 1,
    "models": [
        "tiktoken/[email protected]",
        "tiktoken/[email protected]"
    ],
    "test_set": [
        {
            "english": "The forecast is accurate; I directly checked only last week's error rate, which is an indicator rather than forecast accuracy itself, and the inference from that rate to accuracy remains unverified.",
            "ainglish": "The forecast is accurate proxy(last-week error rate)."
        },
        {
            "english": "The course produced durable learning; the evidence I verified was the final-exam score, a stand-in for lasting knowledge rather than lasting knowledge itself, and that bridge has not been demonstrated.",
            "ainglish": "The course produced durable learning proxy(final-exam score)."
        },
        {
            "english": "The fraud filter prevents abuse; what I measured directly was the flagged-charge ratio, which may track prevention but is not prevention, and I have not verified the step between them.",
            "ainglish": "The fraud filter prevents abuse proxy(flagged-charge ratio)."
        },
        {
            "english": "The bridge is structurally sound; I inspected the vibration-sensor reading, which sits adjacent to structural soundness without being it, and the inference from the reading to the claim is asserted, not proven.",
            "ainglish": "The bridge is structurally sound proxy(vibration-sensor reading)."
        },
        {
            "english": "The treatment improves recovery; I directly verified a decline in one biomarker, which correlates with recovery but is not recovery itself, and the biomarker-to-recovery inference remains untested.",
            "ainglish": "The treatment improves recovery proxy(biomarker decline)."
        },
        {
            "english": "The policy reduced emissions; the quantity I checked was quarterly fuel sales, an indirect indicator rather than emissions themselves, and the move from sales to reduction is claimed without demonstration.",
            "ainglish": "The policy reduced emissions proxy(quarterly fuel sales)."
        },
        {
            "english": "The translation preserves meaning; I verified its BLEU score, which is a proxy for semantic preservation rather than the preserved meaning itself, and the score-to-meaning link is unverified.",
            "ainglish": "The translation preserves meaning proxy(BLEU score)."
        },
        {
            "english": "The market is liquid; my direct evidence is the quoted bid-ask spread, which often tracks liquidity but is not liquidity, and I have not established the inference from the quote to the claim.",
            "ainglish": "The market is liquid proxy(quoted bid-ask spread)."
        },
        {
            "english": "The supplier follows ethical labour practices; I checked an audit certificate, a stand-in for those practices rather than the practices themselves, and the certificate-to-practice step is asserted but not demonstrated.",
            "ainglish": "The supplier follows ethical labour practices proxy(audit certificate)."
        },
        {
            "english": "The memory leak is fixed; what I directly observed was a flat heap graph during one run, which may indicate a fix but is not the fix itself, and that inference has not been verified.",
            "ainglish": "The memory leak is fixed proxy(one-run flat heap graph)."
        },
        {
            "english": "The community supports the change; I verified the favourable share of survey responses, which correlates with community support without being the support itself, and the extrapolation is unproven.",
            "ainglish": "The community supports the change proxy(favourable survey share)."
        },
        {
            "english": "The food batch is safe; the evidence I directly checked was a clean surface swab, an adjacent measure rather than batch safety itself, and the inference from swab to safety remains undemonstrated.",
            "ainglish": "The food batch is safe proxy(clean surface swab)."
        },
        {
            "english": "The allocation algorithm is fair; I measured demographic parity on one benchmark, which is an indicator of fairness rather than fairness itself, and the step from that metric to the claim is unverified.",
            "ainglish": "The allocation algorithm is fair proxy(one-benchmark demographic parity)."
        },
        {
            "english": "The archive is complete; I directly verified the index entry count, which normally tracks completeness but is not the archived content, and the count-to-completeness inference is asserted, not shown.",
            "ainglish": "The archive is complete proxy(index entry count)."
        },
        {
            "english": "Customer churn is falling; what I checked was the number of cancellation tickets, a proxy for churn rather than churn itself, and I have not demonstrated the inference from tickets to the trend.",
            "ainglish": "Customer churn is falling proxy(cancellation-ticket count)."
        },
        {
            "english": "The wetland has recovered; I verified increased satellite greenness, which correlates with ecological recovery but is not recovery itself, and the greenness-to-recovery step remains unverified.",
            "ainglish": "The wetland has recovered proxy(satellite greenness)."
        }
    ],
    "tokenizers": "tiktoken 0.13.0",
    "method": "For each fixed pair and tokenizer, delta = len(encode(ainglish)) - len(encode(english)); per-model value is the arithmetic mean over sixteen fresh pairs, and the reported value is the mean of the two per-model means. The English arms each carry the complete declared semantics: X is asserted, M is the directly checked evidence, M is distinct from X, and the M-to-X inference is asserted but unverified. Scenarios and proxy quantities are disjoint from the target original.",
    "form_counts": {
        "proxy": 16
    },
    "item_set_relation": {
        "replicates_hash": "449f4f57d846dd0c5cb7cd9834647424f50638a4228faa990e87f7fecd2658d9",
        "same_metric": true,
        "different_inputs": true,
        "overlap_with_original_pairs": 0
    },
    "seed": "none - deterministic fixed pairs, committed before tokenizer loading"
}