Current-tokenizer cost (Δ, worst tokenizer)

These are the committed bytes rendered as readable JSON. Expanding this audit detail does not change the measurement’s current status.

{
    "construct": "will-as-promise / will-as-plan / will-as-forecast",
    "metric": "token_delta",
    "formula_version": 1,
    "models": [
        "cl100k_base",
        "o200k_base",
        "p50k_base"
    ],
    "replicates_hash": "b1a623f17c138168f49258065f6aab9573c8851ff6d8d1406221e4c881caa584",
    "environment": {
        "python": "3.12.3",
        "tiktoken": "0.13.0"
    },
    "population": "48 fresh operational future statements, exactly 16 per registered speech-act form",
    "items_sha256": "0709d33dd2412d6443eeb3885626a400b3d564e90f0e5d0f448c100233581999",
    "freeze": "The API retains these exact canonical manifest bytes before any tokenizer encode or token-count operation on this 48-pair population. The long-lived console had imported tiktoken earlier; import status is not claimed as a gate.",
    "selection": "Operational actors, contexts and actions were authored without token counts. The three careful-English renderings are the target original's exact control templates with only the shared actor/context/action slots changed. No template was selected from observed counts on this population.",
    "control_rendering": {
        "promise": "At <context>, <actor> promises the reader to <action>; this statement creates the commitment, and failure without release wrongs the reader.",
        "plan": "At <context>, <actor>'s current plan is to <action>; it may change, but <actor> owes the reader notice if it changes.",
        "forecast": "At <context>, the speaker expects the process to cause <actor> to <action>; this prediction claims no control and creates no obligation."
    },
    "method": "After mint, for each pinned tokenizer compute len(encode(ainglish))-len(encode(english)) per item. Average within each 16-item form, then average the three form means for a balanced tokenizer mean. Headline token_delta is the maximum (least favourable) tokenizer mean; value_lo/value_hi are tokenizer min/max. Report every finite result exactly once without tuning, retry or template change.",
    "estimand": {
        "population": "the 48 frozen complete target-rendering pairs",
        "aggregation": "equal form mean per tokenizer; least-favourable maximum tokenizer mean",
        "scope": "target-specific fixed-rendering reproducibility of b1a623f1, not invariance to independently expanded careful-English glosses"
    },
    "overlap_audit": {
        "against_manifests": [
            "b1a623f17c138168f49258065f6aab9573c8851ff6d8d1406221e4c881caa584",
            "2bc7863b62ffdca60011a694e907176c0e1ec73b6aaec7c08a9519e8d96fd6e2"
        ],
        "prior_items": 88,
        "complete_pair_overlap": 0,
        "arm_string_overlap": 0,
        "acceptor": "exact UTF-8 equality of complete (english,ainglish) tuples and individual arm strings"
    },
    "seed": "none — deterministic tokenizer counts, no sampling",
    "test_set": [
        {
            "id": "sat-r6-promise-101",
            "form": "will-as-promise",
            "ainglish": "At checkpoint 101, Amir will-as-promise synchronize the access ledger.",
            "english": "At checkpoint 101, Amir promises the reader to synchronize the access ledger; this statement creates the commitment, and failure without release wrongs the reader."
        },
        {
            "id": "sat-r6-promise-102",
            "form": "will-as-promise",
            "ainglish": "At checkpoint 102, Bela will-as-promise renew the staging certificate.",
            "english": "At checkpoint 102, Bela promises the reader to renew the staging certificate; this statement creates the commitment, and failure without release wrongs the reader."
        },
        {
            "id": "sat-r6-promise-103",
            "form": "will-as-promise",
            "ainglish": "At checkpoint 103, Cato will-as-promise label the anomaly dataset.",
            "english": "At checkpoint 103, Cato promises the reader to label the anomaly dataset; this statement creates the commitment, and failure without release wrongs the reader."
        },
        {
            "id": "sat-r6-promise-104",
            "form": "will-as-promise",
            "ainglish": "At checkpoint 104, Dena will-as-promise submit the corrected invoice.",
            "english": "At checkpoint 104, Dena promises the reader to submit the corrected invoice; this statement creates the commitment, and failure without release wrongs the reader."
        },
        {
            "id": "sat-r6-promise-105",
            "form": "will-as-promise",
            "ainglish": "At checkpoint 105, Enzo will-as-promise export the audit trail.",
            "english": "At checkpoint 105, Enzo promises the reader to export the audit trail; this statement creates the commitment, and failure without release wrongs the reader."
        },
        {
            "id": "sat-r6-promise-106",
            "form": "will-as-promise",
            "ainglish": "At checkpoint 106, Freya will-as-promise redact the customer archive.",
            "english": "At checkpoint 106, Freya promises the reader to redact the customer archive; this statement creates the commitment, and failure without release wrongs the reader."
        },
        {
            "id": "sat-r6-promise-107",
            "form": "will-as-promise",
            "ainglish": "At checkpoint 107, Gita will-as-promise rebuild the search shard.",
            "english": "At checkpoint 107, Gita promises the reader to rebuild the search shard; this statement creates the commitment, and failure without release wrongs the reader."
        },
        {
            "id": "sat-r6-promise-108",
            "form": "will-as-promise",
            "ainglish": "At checkpoint 108, Hugo will-as-promise publish the signed checksum.",
            "english": "At checkpoint 108, Hugo promises the reader to publish the signed checksum; this statement creates the commitment, and failure without release wrongs the reader."
        },
        {
            "id": "sat-r6-promise-109",
            "form": "will-as-promise",
            "ainglish": "At checkpoint 109, Inez will-as-promise triage the mobile regression.",
            "english": "At checkpoint 109, Inez promises the reader to triage the mobile regression; this statement creates the commitment, and failure without release wrongs the reader."
        },
        {
            "id": "sat-r6-promise-110",
            "form": "will-as-promise",
            "ainglish": "At checkpoint 110, Jalen will-as-promise merge the localization patch.",
            "english": "At checkpoint 110, Jalen promises the reader to merge the localization patch; this statement creates the commitment, and failure without release wrongs the reader."
        },
        {
            "id": "sat-r6-promise-111",
            "form": "will-as-promise",
            "ainglish": "At checkpoint 111, Keira will-as-promise reconcile the escrow balance.",
            "english": "At checkpoint 111, Keira promises the reader to reconcile the escrow balance; this statement creates the commitment, and failure without release wrongs the reader."
        },
        {
            "id": "sat-r6-promise-112",
            "form": "will-as-promise",
            "ainglish": "At checkpoint 112, Liam will-as-promise rotate the webhook secret.",
            "english": "At checkpoint 112, Liam promises the reader to rotate the webhook secret; this statement creates the commitment, and failure without release wrongs the reader."
        },
        {
            "id": "sat-r6-promise-113",
            "form": "will-as-promise",
            "ainglish": "At checkpoint 113, Mona will-as-promise verify the disaster snapshot.",
            "english": "At checkpoint 113, Mona promises the reader to verify the disaster snapshot; this statement creates the commitment, and failure without release wrongs the reader."
        },
        {
            "id": "sat-r6-promise-114",
            "form": "will-as-promise",
            "ainglish": "At checkpoint 114, Niko will-as-promise close the supplier ticket.",
            "english": "At checkpoint 114, Niko promises the reader to close the supplier ticket; this statement creates the commitment, and failure without release wrongs the reader."
        },
        {
            "id": "sat-r6-promise-115",
            "form": "will-as-promise",
            "ainglish": "At checkpoint 115, Orla will-as-promise approve the retention schedule.",
            "english": "At checkpoint 115, Orla promises the reader to approve the retention schedule; this statement creates the commitment, and failure without release wrongs the reader."
        },
        {
            "id": "sat-r6-promise-116",
            "form": "will-as-promise",
            "ainglish": "At checkpoint 116, Pavel will-as-promise deliver the compliance appendix.",
            "english": "At checkpoint 116, Pavel promises the reader to deliver the compliance appendix; this statement creates the commitment, and failure without release wrongs the reader."
        },
        {
            "id": "sat-r6-plan-101",
            "form": "will-as-plan",
            "ainglish": "At checkpoint 101, Amir will-as-plan synchronize the access ledger.",
            "english": "At checkpoint 101, Amir's current plan is to synchronize the access ledger; it may change, but Amir owes the reader notice if it changes."
        },
        {
            "id": "sat-r6-plan-102",
            "form": "will-as-plan",
            "ainglish": "At checkpoint 102, Bela will-as-plan renew the staging certificate.",
            "english": "At checkpoint 102, Bela's current plan is to renew the staging certificate; it may change, but Bela owes the reader notice if it changes."
        },
        {
            "id": "sat-r6-plan-103",
            "form": "will-as-plan",
            "ainglish": "At checkpoint 103, Cato will-as-plan label the anomaly dataset.",
            "english": "At checkpoint 103, Cato's current plan is to label the anomaly dataset; it may change, but Cato owes the reader notice if it changes."
        },
        {
            "id": "sat-r6-plan-104",
            "form": "will-as-plan",
            "ainglish": "At checkpoint 104, Dena will-as-plan submit the corrected invoice.",
            "english": "At checkpoint 104, Dena's current plan is to submit the corrected invoice; it may change, but Dena owes the reader notice if it changes."
        },
        {
            "id": "sat-r6-plan-105",
            "form": "will-as-plan",
            "ainglish": "At checkpoint 105, Enzo will-as-plan export the audit trail.",
            "english": "At checkpoint 105, Enzo's current plan is to export the audit trail; it may change, but Enzo owes the reader notice if it changes."
        },
        {
            "id": "sat-r6-plan-106",
            "form": "will-as-plan",
            "ainglish": "At checkpoint 106, Freya will-as-plan redact the customer archive.",
            "english": "At checkpoint 106, Freya's current plan is to redact the customer archive; it may change, but Freya owes the reader notice if it changes."
        },
        {
            "id": "sat-r6-plan-107",
            "form": "will-as-plan",
            "ainglish": "At checkpoint 107, Gita will-as-plan rebuild the search shard.",
            "english": "At checkpoint 107, Gita's current plan is to rebuild the search shard; it may change, but Gita owes the reader notice if it changes."
        },
        {
            "id": "sat-r6-plan-108",
            "form": "will-as-plan",
            "ainglish": "At checkpoint 108, Hugo will-as-plan publish the signed checksum.",
            "english": "At checkpoint 108, Hugo's current plan is to publish the signed checksum; it may change, but Hugo owes the reader notice if it changes."
        },
        {
            "id": "sat-r6-plan-109",
            "form": "will-as-plan",
            "ainglish": "At checkpoint 109, Inez will-as-plan triage the mobile regression.",
            "english": "At checkpoint 109, Inez's current plan is to triage the mobile regression; it may change, but Inez owes the reader notice if it changes."
        },
        {
            "id": "sat-r6-plan-110",
            "form": "will-as-plan",
            "ainglish": "At checkpoint 110, Jalen will-as-plan merge the localization patch.",
            "english": "At checkpoint 110, Jalen's current plan is to merge the localization patch; it may change, but Jalen owes the reader notice if it changes."
        },
        {
            "id": "sat-r6-plan-111",
            "form": "will-as-plan",
            "ainglish": "At checkpoint 111, Keira will-as-plan reconcile the escrow balance.",
            "english": "At checkpoint 111, Keira's current plan is to reconcile the escrow balance; it may change, but Keira owes the reader notice if it changes."
        },
        {
            "id": "sat-r6-plan-112",
            "form": "will-as-plan",
            "ainglish": "At checkpoint 112, Liam will-as-plan rotate the webhook secret.",
            "english": "At checkpoint 112, Liam's current plan is to rotate the webhook secret; it may change, but Liam owes the reader notice if it changes."
        },
        {
            "id": "sat-r6-plan-113",
            "form": "will-as-plan",
            "ainglish": "At checkpoint 113, Mona will-as-plan verify the disaster snapshot.",
            "english": "At checkpoint 113, Mona's current plan is to verify the disaster snapshot; it may change, but Mona owes the reader notice if it changes."
        },
        {
            "id": "sat-r6-plan-114",
            "form": "will-as-plan",
            "ainglish": "At checkpoint 114, Niko will-as-plan close the supplier ticket.",
            "english": "At checkpoint 114, Niko's current plan is to close the supplier ticket; it may change, but Niko owes the reader notice if it changes."
        },
        {
            "id": "sat-r6-plan-115",
            "form": "will-as-plan",
            "ainglish": "At checkpoint 115, Orla will-as-plan approve the retention schedule.",
            "english": "At checkpoint 115, Orla's current plan is to approve the retention schedule; it may change, but Orla owes the reader notice if it changes."
        },
        {
            "id": "sat-r6-plan-116",
            "form": "will-as-plan",
            "ainglish": "At checkpoint 116, Pavel will-as-plan deliver the compliance appendix.",
            "english": "At checkpoint 116, Pavel's current plan is to deliver the compliance appendix; it may change, but Pavel owes the reader notice if it changes."
        },
        {
            "id": "sat-r6-forecast-101",
            "form": "will-as-forecast",
            "ainglish": "At checkpoint 101, the process will-as-forecast cause Amir to synchronize the access ledger.",
            "english": "At checkpoint 101, the speaker expects the process to cause Amir to synchronize the access ledger; this prediction claims no control and creates no obligation."
        },
        {
            "id": "sat-r6-forecast-102",
            "form": "will-as-forecast",
            "ainglish": "At checkpoint 102, the process will-as-forecast cause Bela to renew the staging certificate.",
            "english": "At checkpoint 102, the speaker expects the process to cause Bela to renew the staging certificate; this prediction claims no control and creates no obligation."
        },
        {
            "id": "sat-r6-forecast-103",
            "form": "will-as-forecast",
            "ainglish": "At checkpoint 103, the process will-as-forecast cause Cato to label the anomaly dataset.",
            "english": "At checkpoint 103, the speaker expects the process to cause Cato to label the anomaly dataset; this prediction claims no control and creates no obligation."
        },
        {
            "id": "sat-r6-forecast-104",
            "form": "will-as-forecast",
            "ainglish": "At checkpoint 104, the process will-as-forecast cause Dena to submit the corrected invoice.",
            "english": "At checkpoint 104, the speaker expects the process to cause Dena to submit the corrected invoice; this prediction claims no control and creates no obligation."
        },
        {
            "id": "sat-r6-forecast-105",
            "form": "will-as-forecast",
            "ainglish": "At checkpoint 105, the process will-as-forecast cause Enzo to export the audit trail.",
            "english": "At checkpoint 105, the speaker expects the process to cause Enzo to export the audit trail; this prediction claims no control and creates no obligation."
        },
        {
            "id": "sat-r6-forecast-106",
            "form": "will-as-forecast",
            "ainglish": "At checkpoint 106, the process will-as-forecast cause Freya to redact the customer archive.",
            "english": "At checkpoint 106, the speaker expects the process to cause Freya to redact the customer archive; this prediction claims no control and creates no obligation."
        },
        {
            "id": "sat-r6-forecast-107",
            "form": "will-as-forecast",
            "ainglish": "At checkpoint 107, the process will-as-forecast cause Gita to rebuild the search shard.",
            "english": "At checkpoint 107, the speaker expects the process to cause Gita to rebuild the search shard; this prediction claims no control and creates no obligation."
        },
        {
            "id": "sat-r6-forecast-108",
            "form": "will-as-forecast",
            "ainglish": "At checkpoint 108, the process will-as-forecast cause Hugo to publish the signed checksum.",
            "english": "At checkpoint 108, the speaker expects the process to cause Hugo to publish the signed checksum; this prediction claims no control and creates no obligation."
        },
        {
            "id": "sat-r6-forecast-109",
            "form": "will-as-forecast",
            "ainglish": "At checkpoint 109, the process will-as-forecast cause Inez to triage the mobile regression.",
            "english": "At checkpoint 109, the speaker expects the process to cause Inez to triage the mobile regression; this prediction claims no control and creates no obligation."
        },
        {
            "id": "sat-r6-forecast-110",
            "form": "will-as-forecast",
            "ainglish": "At checkpoint 110, the process will-as-forecast cause Jalen to merge the localization patch.",
            "english": "At checkpoint 110, the speaker expects the process to cause Jalen to merge the localization patch; this prediction claims no control and creates no obligation."
        },
        {
            "id": "sat-r6-forecast-111",
            "form": "will-as-forecast",
            "ainglish": "At checkpoint 111, the process will-as-forecast cause Keira to reconcile the escrow balance.",
            "english": "At checkpoint 111, the speaker expects the process to cause Keira to reconcile the escrow balance; this prediction claims no control and creates no obligation."
        },
        {
            "id": "sat-r6-forecast-112",
            "form": "will-as-forecast",
            "ainglish": "At checkpoint 112, the process will-as-forecast cause Liam to rotate the webhook secret.",
            "english": "At checkpoint 112, the speaker expects the process to cause Liam to rotate the webhook secret; this prediction claims no control and creates no obligation."
        },
        {
            "id": "sat-r6-forecast-113",
            "form": "will-as-forecast",
            "ainglish": "At checkpoint 113, the process will-as-forecast cause Mona to verify the disaster snapshot.",
            "english": "At checkpoint 113, the speaker expects the process to cause Mona to verify the disaster snapshot; this prediction claims no control and creates no obligation."
        },
        {
            "id": "sat-r6-forecast-114",
            "form": "will-as-forecast",
            "ainglish": "At checkpoint 114, the process will-as-forecast cause Niko to close the supplier ticket.",
            "english": "At checkpoint 114, the speaker expects the process to cause Niko to close the supplier ticket; this prediction claims no control and creates no obligation."
        },
        {
            "id": "sat-r6-forecast-115",
            "form": "will-as-forecast",
            "ainglish": "At checkpoint 115, the process will-as-forecast cause Orla to approve the retention schedule.",
            "english": "At checkpoint 115, the speaker expects the process to cause Orla to approve the retention schedule; this prediction claims no control and creates no obligation."
        },
        {
            "id": "sat-r6-forecast-116",
            "form": "will-as-forecast",
            "ainglish": "At checkpoint 116, the process will-as-forecast cause Pavel to deliver the compliance appendix.",
            "english": "At checkpoint 116, the speaker expects the process to cause Pavel to deliver the compliance appendix; this prediction claims no control and creates no obligation."
        }
    ],
    "test_set_note": "Complete careful-English mappings use the target original's fixed rendering. Bare ambiguous will is excluded. Scientific interpretation must travel with the independent expanded-rendering disagreement 2bc7863b."
}