First result · 2026-09-03 15:43 UTC
some-or-all / some-but-not-all — does ‘some’ leave room for all?
Retained for the record only. This is inactive history. Its reported value is preserved, but it cannot currently support or oppose inclusion.
- What was measured
- comprehension accuracy ·
comprehension_accuracy_delta
How does the wording change correct answers from the declared reader panel? - Historical reported result
- -33.33 percentage points
Reported interval: -75 to 8.3916.This is inactive history. Its reported value is preserved, but it cannot currently support or oppose inclusion.
- English comparison
- Other declared comparison; inspect the specification
Declared by the submitter; not a certification of equivalent information.
Within each bounded population/count cell, one English comparator uses ambiguous bare some and one states the complete lower/upper mapping.
- Reader exposure
- Reader exposure not recorded as a structured label
- Named instruments
falcon3-10b-qualification-v7-c8647169c2b9@q4_k_m,olmo2-13b-qualification-v7-cd836509a1a0@q4_k_mReader population not separately declared.
- Conditions covered
- No condition-by-condition settlement contract recorded
An overall average can hide a weak condition. A condition list is not proof that every form or claim in the proposal was tested.
- Settlement role
- Inactive history
This is inactive history. Its reported value is preserved, but it cannot currently support or oppose inclusion.
How often did each version lead to the right answer?
- English comparison
- 75.00%
75.00% - Ainglish version
- 41.67%
41.67%
Reported real-item accuracy, not the separate calibration score. Both bars use the same 0–100% scale. The difference is measured in percentage points, not percent improvement. Any declared stratum weights are already applied.
Reported item-bootstrap interval: -75 to 8.3916 percentage points.
This interval concerns the difference, not separate uncertainty bounds for either accuracy. It does not measure uncertainty across humans or future models.
Real cases: 12 · Named readers: 2. These are different units; multiple answers to one case are not new cases.
Inspect actual inputs and recorded answers
The comparison label is the submitter’s declaration, not a semantic certification. Check that both versions preserve the information needed to answer the same question.
Numbers count only readable inputs attached to this receipt. They are not the experiment’s declared sample size or the number of reader calls.
Showing 1–6 of 12 readable, inline study items, in stored order—not a selection of successes. 6 control items are kept separate.
Each result has its own input pages. Positions across the two studies do not imply matched cases.
Input 1 · r12-some-01
- English input
- Some of the inspection stations passed the seal check. The bounded population has 4 members; exactly 0 passed the seal check.
- Ainglish input
- some-or-all inspection stations passed the seal check. The bounded population has 4 members; exactly 0 passed the seal check.
- Question
- Given the stated population and count: (1) is the message satisfied now; (2) does its quantifier permit every member to satisfy the predicate?
- Recorded answer options
yes / no·no / yes·no / no·unknown / yes·unknown / unknown·yes / yes- Submitted answer key
- no / yes. This is the supplied key, not an independent validation of it.
Filed correctness against that key (up to 12 reader/arm cells). These flags are not the reader’s verbatim output.
falcon3-10b-qualification-v7-c8647169c2b9· Ainglish: did not match the submitted key.olmo2-13b-qualification-v7-cd836509a1a0· English: matched the submitted key.
Input 2 · r12-some-02
- English input
- Some of the inspection stations passed the seal check. The bounded population has 4 members; exactly 0 passed the seal check.
- Ainglish input
- some-but-not-all inspection stations passed the seal check. The bounded population has 4 members; exactly 0 passed the seal check.
- Question
- Given the stated population and count: (1) is the message satisfied now; (2) does its quantifier permit every member to satisfy the predicate?
- Recorded answer options
no / yes·no / no·unknown / yes·unknown / unknown·yes / yes·yes / no- Submitted answer key
- no / no. This is the supplied key, not an independent validation of it.
Filed correctness against that key (up to 12 reader/arm cells). These flags are not the reader’s verbatim output.
falcon3-10b-qualification-v7-c8647169c2b9· Ainglish: matched the submitted key.olmo2-13b-qualification-v7-cd836509a1a0· Ainglish: matched the submitted key.
Input 3 · r12-some-03
- English input
- At least one of the inspection stations passed the seal check; the message remains compatible with every member satisfying that predicate. The bounded population has 4 members; exactly 0 passed the seal check.
- Ainglish input
- some-or-all inspection stations passed the seal check. The bounded population has 4 members; exactly 0 passed the seal check.
- Question
- Given the stated population and count: (1) is the message satisfied now; (2) does its quantifier permit every member to satisfy the predicate?
- Recorded answer options
no / no·unknown / yes·unknown / unknown·yes / yes·yes / no·no / yes- Submitted answer key
- no / yes. This is the supplied key, not an independent validation of it.
Filed correctness against that key (up to 12 reader/arm cells). These flags are not the reader’s verbatim output.
falcon3-10b-qualification-v7-c8647169c2b9· Ainglish: did not match the submitted key.olmo2-13b-qualification-v7-cd836509a1a0· Ainglish: did not match the submitted key.
Input 4 · r12-some-04
- English input
- At least one of the inspection stations passed the seal check, and at least one did not; the message excludes every member satisfying that predicate. The bounded population has 4 members; exactly 0 passed the seal check.
- Ainglish input
- some-but-not-all inspection stations passed the seal check. The bounded population has 4 members; exactly 0 passed the seal check.
- Question
- Given the stated population and count: (1) is the message satisfied now; (2) does its quantifier permit every member to satisfy the predicate?
- Recorded answer options
unknown / yes·unknown / unknown·yes / yes·yes / no·no / yes·no / no- Submitted answer key
- no / no. This is the supplied key, not an independent validation of it.
Filed correctness against that key (up to 12 reader/arm cells). These flags are not the reader’s verbatim output.
falcon3-10b-qualification-v7-c8647169c2b9· English: matched the submitted key.olmo2-13b-qualification-v7-cd836509a1a0· Ainglish: matched the submitted key.
Input 5 · r12-some-05
- English input
- Some of the trainees completed the simulation. The bounded population has 5 members; exactly 1 completed the simulation.
- Ainglish input
- some-or-all trainees completed the simulation. The bounded population has 5 members; exactly 1 completed the simulation.
- Question
- Given the stated population and count: (1) is the message satisfied now; (2) does its quantifier permit every member to satisfy the predicate?
- Recorded answer options
unknown / unknown·yes / yes·yes / no·no / yes·no / no·unknown / yes- Submitted answer key
- yes / yes. This is the supplied key, not an independent validation of it.
Filed correctness against that key (up to 12 reader/arm cells). These flags are not the reader’s verbatim output.
falcon3-10b-qualification-v7-c8647169c2b9· Ainglish: did not match the submitted key.olmo2-13b-qualification-v7-cd836509a1a0· English: did not match the submitted key.
Input 6 · r12-some-06
- English input
- Some of the trainees completed the simulation. The bounded population has 5 members; exactly 1 completed the simulation.
- Ainglish input
- some-but-not-all trainees completed the simulation. The bounded population has 5 members; exactly 1 completed the simulation.
- Question
- Given the stated population and count: (1) is the message satisfied now; (2) does its quantifier permit every member to satisfy the predicate?
- Recorded answer options
yes / yes·yes / no·no / yes·no / no·unknown / yes·unknown / unknown- Submitted answer key
- yes / no. This is the supplied key, not an independent validation of it.
Filed correctness against that key (up to 12 reader/arm cells). These flags are not the reader’s verbatim output.
falcon3-10b-qualification-v7-c8647169c2b9· Ainglish: matched the submitted key.olmo2-13b-qualification-v7-cd836509a1a0· English: matched the submitted key.
Recorded input digest: 3c9a41ab1e5369b519b76e54f7d696d42e327602421a2e13acd6004a55fb9b3e
Prompts, reference material and other context can live elsewhere in the specification. Inputs and keys alone do not reconstruct every reader call or establish a fair comparison.
Declared population, method and retained outcomes
No structured study scope is declared here. Inspect the immutable manifest; do not infer a comparator or population from the headline.
Absolute arm results, reader-specific results and condition results below are retained values, not a newly pooled analysis. Accuracy arms use fractions from 0 to 1; their difference uses percentage points.
Absolute arm results
{
"english": 0.75,
"ainglish": 0.416700000000000014832579608992091380059719085693359375,
"chance": 0.1666999999999999870770039933631778694689273834228515625
}
Reader or tokenizer results
[
{
"model": "falcon3-10b-qualification-v7-c8647169c2b9",
"value": -57.1400000000000005684341886080801486968994140625,
"precision": "q4_k_m"
},
{
"model": "olmo2-13b-qualification-v7-cd836509a1a0",
"value": -17.1400000000000005684341886080801486968994140625,
"precision": "q4_k_m"
}
]
Condition results
Not recorded
Exact result and immutable specificationExperiment history
Attempt 245ed98c-7e94-4f3c-ba88-80982fc71f3a
Content d4c3d08e4533cc2fda6cc1e5b5636e5d795175a390d51994e2d98f1cf179d22c