Learning gain

Area: definition. Apply the shared measurement protocol.

Estimated progress toward AI-managed education

15% complete — judgment-based estimate as of November 7, 2026. Confidence: low. The scale starts at 0% before ChatGPT's public release in 2022 and ends at 100% when AI manages the field's continuing advancement without human participation. This rates the outcome's contribution to that transition, not the percentage of tasks solved, a measured fraction of the field, or time remaining.

The shared scoring rubric uses five equally weighted dimensions: execution, breadth, agenda-setting, validation, and sustained autonomous improvement. Points for this outcome are 5 + 5 + 0 + 5 + 0 = 15/100, in that order; each dimension has a maximum of 20. These component judgments make the estimate inspectable, but are not independently measured scores.

Reason for the estimate: Controlled assessment exists, but the cited negative trial prevents credit for dependable learning gains from tutor access alone. Humans still design and evaluate instruction. The dated baseline below supplies the findings and source links used for this assessment. Unmeasured components receive no demonstrated-progress credit; missing evidence does not prove a missing capability.

What would move the score: Replicate with independent assessment and baseline adjustment; report intention-to-treat effects, uptake, subject, instructional design and uncertainty. Higher autonomy scores additionally require AI to select worthwhile work, validate results and improve the process over repeated cycles without human research management, repair or adjudication. Lower the score if replication fails, quality regresses or previously hidden human assistance is found. Preserve this dated estimate when adding future assessments.

Measurement and acceptance rule

Difference in independently administered assessment scores after adjusting for baseline, with absolute and standardized effects and uncertainty.

Evidence requirements

Use randomized or otherwise well-controlled comparisons against competent instruction. Separate assessment creation from tutor design, prevent answer leakage, and test students without the tool. Measure dropout and intention-to-treat outcomes, not just outcomes among enthusiastic completers. Track incorrect instruction and dependence on assistance. Student satisfaction and fluent homework are not substitutes for demonstrated learning.

Related milestones

See the area's proposed milestones. Proposed targets are distinct from the dated evidence below.

Baseline as of November 7 2026

Status: Randomized evidence includes negative effects. Sources accessed November 7, 2026. This is a documentary baseline, not an independent replication or an assertion of the worldwide best result. An unknown measurement is not zero.

Dated findings

October 2026: An October 2026 working paper covering 2,379 students and 30 instructors reports AI-tutor access reducing final grades by 0.37 standard deviations and LMS participation by 0.90 standard deviations. IZA: course-integrated AI tutoring randomized trial.

Interpretation and tracking value

This working-paper result concerns a particular course-integrated intervention, not all AI tutoring. Access, actual use and pedagogy must be separated.

Next comparable measurement

Replicate with independent assessment and baseline adjustment; report intention-to-treat effects, uptake, subject, instructional design and uncertainty. Preserve this dated observation; append future results with their model/system version, denominator, budget and evidence level rather than overwriting it.