{"id":"AIBD-0716","title":"The What Works Clearinghouse finds that DreamBox Learning had potentially positive effects on math for kindergarten and first-grade students","summary":"The What Works Clearinghouse rated DreamBox Learning as having potentially positive effects on math, an improvement index of +4, in a trial with 557 kindergarten and first-grade students.","date_observed":"2011-02-01","date_basis":"event","date_precision":"month","benefit_status":"reported","source_collection":null,"source_entry":null,"account":"DreamBox Learning is an online supplemental math program for grades K to 5. As students play math games, it adapts the lesson sequence, difficulty, pace and number of hints in real time. SRI International evaluated it in three Rocketship Education charter schools in San Jose, California, from mid-October 2010 to mid-February 2011. Kindergarten and first-grade students were randomly assigned, four to one, to DreamBox or to an online literacy program during the same lab time. Users averaged 21.8 hours on the program, and 557 students were analyzed. The What Works Clearinghouse (WWC) found that the trial meets its standards without reservations. On the MAP math test, users scored a mean of 159.00 against 156.20, an effect size of 0.11. The WWC rated the effects potentially positive, with a small extent of evidence. In its first release on 10 December 2013, the WWC had found no discernible effects. It changed the rating on 5 February 2014 after the authors supplied estimates for the full sample. The WWC does not say whether the program's adaptation is learned from data or who funded the study.","category":"aggregate result","unexpected":false,"purpose":"DreamBox Learning, Inc. built DreamBox Learning to individualize math instruction for students in grades K to 5 with lessons that adapt to each student.","system":"DreamBox Learning (adaptive online K-5 mathematics program)","model_version":null,"developer":"DreamBox Learning, Inc.","deployer":"Rocketship Education (three charter elementary schools in San Jose, California)","location":"San Jose, California, United States","domain":"Education","segment":null,"benefit_type":"Improved Learning","work_activities":["4.A.4.b.3"],"taxonomy_note":null,"registry_ids":{},"ratings":[{"group":"personal","depth":2,"reason":"The WWC found a statistically significant gain of 0.11 standard deviations on a standardized math test, an improvement index of +4 percentile points."}],"ai_role":{"status":"assessed","statement":"The trial compared students who used DreamBox with students who spent the same lab time on an online literacy program, so it isolates the program's effect on math. The WWC says that the program adapts in real time but does not show that it learns from data."},"evidence":[{"kind":"assessment report","citation":"U.S. Department of Education, Institute of Education Sciences, What Works Clearinghouse. Elementary School Mathematics intervention report: DreamBox Learning. December 2013, modified 5 February 2014. Pages 1 and 3.","title":"WWC Intervention Report: DreamBox Learning (Elementary School Mathematics)","url":"https://ies.ed.gov/ncee/WWC/Docs/InterventionReports/wwc_dreambox_121013.pdf","date":"2014-02-05","written_by":"independent","quote":"DreamBox Learning was found to have potentially positive effects on mathematics achievement for elementary school students."}],"replication":{"produced_by":["Students used DreamBox in a computer lab at school, averaging 21.8 hours over four months.","The program adapted the lesson sequence, difficulty, pace and number of hints to each student in real time."],"must_hold":["The program supplements classroom math teaching.","The developer recommends at least 90 minutes a week on the program."],"echoes":[]},"paired_incident":null,"headline":"*DreamBox Learning* lifts early math scores in a San Jose trial","metric":"an improvement index of +4","comparator":{"against":"Students randomly assigned to an online literacy program during the same lab time","before":"156.20 (comparison group mean, MAP overall math score)","after":"159.00 (DreamBox group mean)","basis":"measured","quote":"The authors also found a statistically significant positive difference between the groups in an analysis that included the full sample, as reported in response to an author query.","url":"https://ies.ed.gov/ncee/WWC/Docs/InterventionReports/wwc_dreambox_121013.pdf"},"later":null,"value":null,"developer_country":"United States","deployer_country":"United States","unrated_because":null,"brief_notes":null,"brief":null,"revisions":[{"date":"2026-10-31","change":"Added the record from the finding of the What Works Clearinghouse.","source":"https://ies.ed.gov/ncee/WWC/Docs/InterventionReports/wwc_dreambox_121013.pdf","editor":"AIBD"}],"confidence":"found","shade":"high","claim_status":"Found by an assessment body","claim_basis":"Sources: one independent assessment report. The cited evidence includes no independent study or report.","case_jurisdictions":["United States"],"profile":{"case_id":"AIBD-0716","catalog_version":"1.0.0","source_fingerprint":"e0afc0a4685577f65e3ee7f1ed31232e0e014d9378a68b5927531e68d7797820","collection_refs":[{"collection_id":"aibd","version":"2026-10-31"},{"collection_id":"querist","version":"2026-10-25"}],"source_ids":["AIBD-0716-source-0001"],"families":{"strategic assessments":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"evaluations":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"monetary observations":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"institutional decisions":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]}},"fields":{"actors[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"developer":"DreamBox Learning, Inc.","deployer":"Rocketship Education (three charter elementary schools in San Jose, California)"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["developer","deployer"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"actors[].ownership_control":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"ai_contribution":{"state":"value_present","value":{"kind":"record_fields","fields":{"ai_role":{"status":"assessed","statement":"The trial compared students who used DreamBox with students who spent the same lab time on an online literacy program, so it isolates the program's effect on math. The WWC says that the program adapts in real time but does not show that it learns from data."}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ai_role"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"ai_relationship":{"state":"value_present","value":{"kind":"record_fields","fields":{"category":"aggregate result","ai_role":{"status":"assessed","statement":"The trial compared students who used DreamBox with students who spent the same lab time on an online literacy program, so it isolates the program's effect on math. The WWC says that the program adapts in real time but does not show that it learns from data."}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ai_role","category"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].alternatives":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].assessor_date":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].depth":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"personal","depth":2,"reason":"The WWC found a statistically significant gain of 0.11 standard deviations on a standardized math test, an improvement index of +4 percentile points."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].display_confidence":{"state":"value_present","value":{"kind":"structured","data":{"confidence":"high","evidence_word":"found","claim_status":"Found by an assessment body","basis":"Sources: one independent assessment report. The cited evidence includes no independent study or report.","interpretation":"Existing display rule preserved; the richer outcome-specific confidence question still needs review."}},"provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].rationale":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"personal","depth":2,"reason":"The WWC found a statistically significant gain of 0.11 standard deviations on a standardized math test, an improvement index of +4 percentile points."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].rubric_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].status_basis":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].target":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"personal","depth":2,"reason":"The WWC found a statistically significant gain of 0.11 standard deviations on a standardized math test, an improvement index of +4 percentile points."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"availability":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"brief":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"case_kind":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"case_links[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].evidence_links":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].evidence_strength":{"state":"value_present","value":{"kind":"structured","data":{"answer":"Found by an assessment body. Sources: one independent assessment report. The cited evidence includes no independent study or report.","evidence_word":"found","claim_status":"Found by an assessment body"}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0716-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Found by an assessment body. Sources: one independent assessment report. The cited evidence includes no independent study or report.","inferred":false}},"claims[].missingness":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].proposition":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"cross_border_flows[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"decisions[].action_outcome":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].grounds":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].institution_task":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].success_criterion":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"deployment_stage":{"state":"value_present","value":{"kind":"structured","data":{"classification":"pilot","answer":"The system was used in a pilot. The program was used in a four-month randomized trial in three charter schools.","scope":"The period and activity described in the case."}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["account","evidence"],"source_refs":["AIBD-0716-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"The system was used in a pilot. The program was used in a four-month randomized trial in three charter schools.","inferred":false}},"economics[].amount":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].costs[]":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].counterfactual":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].currency_price_basis":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].gross_net":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].measure_type":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].period_unit":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].realization":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].recipient_payer":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].return_payback":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].valuation_method":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"evaluations[].ai_uplift":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].comparator":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].design":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].effect":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].exposure":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].id":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].measurement_method":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].metric":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].reproduction_materials":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].setting_sample":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].uncertainty_limitations":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"external_references[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"follow_up[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"human_oversight":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"id":{"state":"value_present","value":{"kind":"record_fields","fields":{"id":"AIBD-0716"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["id"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"infrastructure_dependencies[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].beneficiaries":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].beneficiary_count":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].benefit_type":{"state":"value_present","value":{"kind":"record_fields","fields":{"benefit_type":"Improved Learning"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["benefit_type"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].claim":{"state":"value_present","value":{"kind":"record_fields","fields":{"account":"DreamBox Learning is an online supplemental math program for grades K to 5. As students play math games, it adapts the lesson sequence, difficulty, pace and number of hints in real time. SRI International evaluated it in three Rocketship Education charter schools in San Jose, California, from mid-October 2010 to mid-February 2011. Kindergarten and first-grade students were randomly assigned, four to one, to DreamBox or to an online literacy program during the same lab time. Users averaged 21.8 hours on the program, and 557 students were analyzed. The What Works Clearinghouse (WWC) found that the trial meets its standards without reservations. On the MAP math test, users scored a mean of 159.00 against 156.20, an effect size of 0.11. The WWC rated the effects potentially positive, with a small extent of evidence. In its first release on 10 December 2013, the WWC had found no discernible effects. It changed the rating on 5 February 2014 after the authors supplied estimates for the full sample. The WWC does not say whether the program's adaptation is learned from data or who funded the study.","benefit_type":"Improved Learning"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["account","benefit_type"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].distribution":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].duration":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].id":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].stakeholder_group":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"personal","depth":2,"reason":"The WWC found a statistically significant gain of 0.11 standard deviations on a standardized math test, an improvement index of +4 percentile points."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].status":{"state":"value_present","value":{"kind":"record_fields","fields":{"benefit_status":"reported"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["benefit_status"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].tradeoffs":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].unexpected":{"state":"value_present","value":{"kind":"record_fields","fields":{"unexpected":false,"purpose":"DreamBox Learning, Inc. built DreamBox Learning to individualize math instruction for students in grades K to 5 with lessons that adapt to each student."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["unexpected","purpose"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"places[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"location":"San Jose, California, United States","developer_country":"United States","deployer_country":"United States"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["location","developer_country","deployer_country"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"purpose":{"state":"value_present","value":{"kind":"record_fields","fields":{"purpose":"DreamBox Learning, Inc. built DreamBox Learning to individualize math instruction for students in grades K to 5 with lessons that adapt to each student."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["purpose"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"record_dates":{"state":"value_present","value":{"kind":"record_fields","fields":{"date_observed":"2011-02-01","date_basis":"event","date_precision":"month","revisions":[{"date":"2026-10-31","change":"Added the record from the finding of the What Works Clearinghouse.","source":"https://ies.ed.gov/ncee/WWC/Docs/InterventionReports/wwc_dreambox_121013.pdf","editor":"AIBD"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["date_observed","date_basis","date_precision","revisions"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"replication.attempts[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"replication.conditions":{"state":"value_present","value":{"kind":"record_fields","fields":{"replication":{"produced_by":["Students used DreamBox in a computer lab at school, averaging 21.8 hours over four months.","The program adapted the lesson sequence, difficulty, pace and number of hints to each student in real time."],"must_hold":["The program supplements classroom math teaching.","The developer recommends at least 90 minutes a week on the program."],"echoes":[]}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["replication"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"revision_history[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"revisions":[{"date":"2026-10-31","change":"Added the record from the finding of the What Works Clearinghouse.","source":"https://ies.ed.gov/ncee/WWC/Docs/InterventionReports/wwc_dreambox_121013.pdf","editor":"AIBD"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["revisions"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sector":{"state":"value_present","value":{"kind":"record_fields","fields":{"domain":"Education"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["domain"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].access_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"sources[].citation_locator":{"state":"value_present","value":{"kind":"record_fields","fields":{"evidence":[{"kind":"assessment report","citation":"U.S. Department of Education, Institute of Education Sciences, What Works Clearinghouse. Elementary School Mathematics intervention report: DreamBox Learning. December 2013, modified 5 February 2014. Pages 1 and 3.","title":"WWC Intervention Report: DreamBox Learning (Elementary School Mathematics)","url":"https://ies.ed.gov/ncee/WWC/Docs/InterventionReports/wwc_dreambox_121013.pdf","date":"2014-02-05","written_by":"independent","quote":"DreamBox Learning was found to have potentially positive effects on mathematics achievement for elementary school students."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].id":{"state":"value_present","value":{"kind":"identifiers","identifiers":["AIBD-0716-source-0001"],"role":"Existing evidence items, in their original order"},"provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"complete"},"sources[].language":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"sources[].relationship":{"state":"value_present","value":{"kind":"record_fields","fields":{"evidence":[{"kind":"assessment report","citation":"U.S. Department of Education, Institute of Education Sciences, What Works Clearinghouse. Elementary School Mathematics intervention report: DreamBox Learning. December 2013, modified 5 February 2014. Pages 1 and 3.","title":"WWC Intervention Report: DreamBox Learning (Elementary School Mathematics)","url":"https://ies.ed.gov/ncee/WWC/Docs/InterventionReports/wwc_dreambox_121013.pdf","date":"2014-02-05","written_by":"independent","quote":"DreamBox Learning was found to have potentially positive effects on mathematics achievement for elementary school students."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].upstream_sources":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"strategic_assessments[]":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"strategic assessments"},"summary":{"state":"value_present","value":{"kind":"record_fields","fields":{"summary":"The What Works Clearinghouse rated DreamBox Learning as having potentially positive effects on math, an improvement index of +4, in a trial with 557 kindergarten and first-grade students.","account":"DreamBox Learning is an online supplemental math program for grades K to 5. As students play math games, it adapts the lesson sequence, difficulty, pace and number of hints in real time. SRI International evaluated it in three Rocketship Education charter schools in San Jose, California, from mid-October 2010 to mid-February 2011. Kindergarten and first-grade students were randomly assigned, four to one, to DreamBox or to an online literacy program during the same lab time. Users averaged 21.8 hours on the program, and 557 students were analyzed. The What Works Clearinghouse (WWC) found that the trial meets its standards without reservations. On the MAP math test, users scored a mean of 159.00 against 156.20, an effect size of 0.11. The WWC rated the effects potentially positive, with a small extent of evidence. In its first release on 10 December 2013, the WWC had found no discernible effects. It changed the rating on 5 February 2014 after the authors supplied estimates for the full sample. The WWC does not say whether the program's adaptation is learned from data or who funded the study."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["summary","account"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"systems[].autonomy_permissions":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].component_role":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].deployment_configuration":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].inputs_outputs":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].model_name":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].model_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].product_name":{"state":"value_present","value":{"kind":"record_fields","fields":{"system":"DreamBox Learning (adaptive online K-5 mathematics program)"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["system"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"systems[].provider":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"taxonomy_crosswalks[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"title":{"state":"value_present","value":{"kind":"record_fields","fields":{"title":"The What Works Clearinghouse finds that DreamBox Learning had potentially positive effects on math for kindergarten and first-grade students","headline":"*DreamBox Learning* lifts early math scores in a San Jose trial"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["title","headline"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"version":{"state":"value_present","value":{"kind":"identifiers","identifiers":["ec0a0caf339ca585c1d4a10c8382eabfc777251ab049404043958638dc3c3a48"],"role":"SHA-256 of the complete public record and its assessments"},"provenance":{"kind":"curatorial","basis":"SHA-256 of the public record, its assessments, and its displayed answers and notes, excluding its own identifier and the derived coverage summary.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"complete"},"workflow":{"state":"value_present","value":{"kind":"record_fields","fields":{"account":"DreamBox Learning is an online supplemental math program for grades K to 5. As students play math games, it adapts the lesson sequence, difficulty, pace and number of hints in real time. SRI International evaluated it in three Rocketship Education charter schools in San Jose, California, from mid-October 2010 to mid-February 2011. Kindergarten and first-grade students were randomly assigned, four to one, to DreamBox or to an online literacy program during the same lab time. Users averaged 21.8 hours on the program, and 557 students were analyzed. The What Works Clearinghouse (WWC) found that the trial meets its standards without reservations. On the MAP math test, users scored a mean of 159.00 against 156.20, an effect size of 0.11. The WWC rated the effects potentially positive, with a small extent of evidence. In its first release on 10 December 2013, the WWC had found no discernible effects. It changed the rating on 5 February 2014 after the authors supplied estimates for the full sample. The WWC does not say whether the program's adaptation is learned from data or who funded the study.","replication":{"produced_by":["Students used DreamBox in a computer lab at school, averaging 21.8 hours over four months.","The program adapted the lesson sequence, difficulty, pace and number of hints to each student in real time."],"must_hold":["The program supplements classroom math teaching.","The developer recommends at least 90 minutes a week on the program."],"echoes":[]}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["account","replication"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"}},"summary":{"total":91,"addressed":91,"known":29,"reviewed":2,"reviewed_complete":2,"reviewed_partial":0,"record_mapped":27,"review_not_assessed":62,"not_assessed":0,"complete":false,"by_state":{"value_present":29,"not_reported":0,"unresolved":62,"not_assessed":0,"not_applicable":0,"withheld":0,"source_unavailable":0}}},"presentation_version":"44410627bb455b0a2468f69912e51f9a977edb4083e23fe62a6c2e7556f817ec"}
