Complete task success

Area: definition. Apply the shared measurement protocol.

Estimated progress toward AI-managed robotics

20% complete — judgment-based estimate as of November 7, 2026. Confidence: low. The scale starts at 0% before ChatGPT's public release in 2022 and ends at 100% when AI manages the field's continuing advancement without human participation. This rates the outcome's contribution to that transition, not the percentage of tasks solved, a measured fraction of the field, or time remaining.

The shared scoring rubric uses five equally weighted dimensions: execution, breadth, agenda-setting, validation, and sustained autonomous improvement. Points for this outcome are 5 + 5 + 5 + 5 + 0 = 20/100, in that order; each dimension has a maximum of 20. These component judgments make the estimate inspectable, but are not independently measured scores.

Reason for the estimate: A structured long-horizon evaluation supports bounded task assessment, but partial credit is not complete physical-task success and no verified whole-task rate was extracted. The dated baseline below supplies the findings and source links used for this assessment. Unmeasured components receive no demonstrated-progress credit; missing evidence does not prove a missing capability.

What would move the score: Archive trial-level results and count only complete end states; report successes/all assignments separately from partial credit and simulation versus physical tests. Higher autonomy scores additionally require AI to select worthwhile work, validate results and improve the process over repeated cycles without human research management, repair or adjudication. Lower the score if replication fails, quality regresses or previously hidden human assistance is found. Preserve this dated estimate when adding future assessments.

Measurement and acceptance rule

Fully completed tasks / all assigned trials, judged against observable end states rather than partial motion success.

Evidence requirements

Use randomized task selection and complete trial logs or video, not selected demonstrations. Separate simulation from physical tests, and supervised operation from autonomy. Define what counts as damage or a near miss. Zero incidents in a small trial is not proof of a low underlying incident rate; report exposure and uncertainty.

Related milestones

See the area's proposed milestones. Proposed targets are distinct from the dated evidence below.

Baseline as of November 7 2026

Status: Benchmark protocol; whole-task rate not verified. Sources accessed November 7, 2026. This is a documentary baseline, not an independent replication or an assertion of the worldwide best result. An unknown measurement is not zero.

Dated findings

2026 challenge; accessed November 7, 2026: BEHAVIOR 2026 evaluates long-horizon household activities using average partial-credit BDDL task success. BEHAVIOR 2026 official challenge.

Interpretation and tracking value

Its primary aggregate is not the fraction of trials completing every required end state. A current whole-task completion rate was not verified from the accessible challenge page.

Next comparable measurement

Archive trial-level results and count only complete end states; report successes/all assignments separately from partial credit and simulation versus physical tests. Preserve this dated observation; append future results with their model/system version, denominator, budget and evidence level rather than overwriting it.