{"id":"AIBD-1153","title":"University of Maryland researchers find that Arizona middle-schoolers who used the Goblins AI math platform scored 0.11 SD higher on MAP math","summary":"In Arizona's Deer Valley district in 2025-26, middle-school students who solved at least two problems a week on Goblins scored 0.109 standard deviations higher on MAP math than similar students.","date_observed":"2026-01-01","date_basis":"event","date_precision":"year","benefit_status":"reported","source_collection":null,"source_entry":null,"account":"Aha Moments built Goblins, a math platform on which students type, draw or speak while an AI tutor gives step-by-step feedback. Deer Valley Unified School District in Arizona offered it to all middle-school math teachers in the 2025-26 school year. Researchers at the University of Maryland compared 6,065 students in grades 6 to 8, weighting them by propensity scores. They found that students who solved at least two problems a week scored 0.109 standard deviations higher on the spring MAP math test. Students who solved 20 or more problems a week scored 0.31 standard deviations higher, but only 164 students reached that level. Accelerate, a nonprofit that also funds Goblins as a grantee, paid for the study. The authors caution that students chose how much to use Goblins, so unmeasured differences may explain part of the gain. Teachers could switch off the AI tutor, so the estimates cover use of the platform in general. The paper appeared as an EdWorkingPaper in October 2026.","category":"aggregate result","unexpected":false,"purpose":"Aha Moments built Goblins to give students step-by-step AI tutoring and feedback on math problems that their teachers assign.","system":"Goblins, a teacher-mediated multimodal AI math platform","model_version":null,"developer":"Aha Moments, Inc. (Goblins)","deployer":"Deer Valley Unified School District, which offered Goblins to all middle-school math teachers in 2025-26","location":"Deer Valley Unified School District, Arizona, United States","domain":"Education","segment":null,"benefit_type":"Improved Learning","work_activities":["4.A.4.b.3","4.A.2.a.1"],"taxonomy_note":null,"registry_ids":{"osf":"5kwbp"},"ratings":[{"group":"personal","depth":2,"reason":"Students who solved at least two problems a week scored 0.109 standard deviations higher on spring MAP math than similar students, in an observational comparison."}],"ai_role":{"status":"unassessed","statement":"The study compares heavier and lighter users weighted to look alike on observed traits, so unmeasured differences may remain. It measures use of the whole platform, and teachers could switch off the AI tutor, so the AI tutor's share is unknown."},"evidence":[{"kind":"report","citation":"Alam A, Dominguez-Mel N, Liu J (Center for Educational Data Science and Innovation, University of Maryland, College Park). Teacher-Mediated Multimodal Platform and Math Achievement: Evidence from Goblins' Yearlong District Implementation. EdWorkingPaper 26-1611, Annenberg Institute at Brown University, October 2026. doi:10.26300/vcdh-yc23. Funded by Accelerate. Pre-analysis plan at osf.io/5kwbp.","title":"Teacher-Mediated Multimodal Platform and Math Achievement: Evidence from Goblins' Yearlong District Implementation","url":"https://edworkingpapers.com/ai26-1611","date":"2026-10-07","written_by":"evaluator","quote":"Using a weighted propensity design, we find that Goblins usage is associated with a 0.11 standard deviation increase in MAP math scores within the district"},{"kind":"press release","citation":"Accelerate. Can an AI Tutor Help Middle Schoolers Learn Math? What a Study of Goblins Among 6,000+ Students Found. Blog post, 7 October 2026. Accelerate funds Goblins as a grantee of its Call for Effective Technology program and commissioned the study.","title":"Can an AI Tutor Help Middle Schoolers Learn Math? What a Study of Goblins Among 6,000+ Students Found","url":"https://accelerate.us/can-an-ai-tutor-help-middle-schoolers-learn-math/","date":"2026-10-07","written_by":"makers","quote":"middle school students who solved at least two problems a week on Goblins scored about 0.11 standard deviations (SDs) higher on MAP math assessments than similar students who had little or no usage, equivalent to nearly three months of additional learning."}],"replication":{"produced_by":["Teachers activated licenses, created classes and assigned content, and they could switch the AI tutor on or off.","Goblins provided professional development for district teachers and instructional leaders in fall 2025.","Students could speak, draw or type their work, with support in seven languages."],"must_hold":["Students must use the platform regularly, and only 50.9% solved at least two problems a week.","Teachers must enroll students in classes on the platform, since students had access only through teacher-created classes."],"echoes":[]},"paired_incident":null,"headline":"*Goblins* AI math platform users score higher in an Arizona district","metric":"0.109 standard deviations higher on MAP math","comparator":{"against":"Similar district students who solved fewer than two problems a week or did not use Goblins","before":null,"after":"0.109 SD higher on the within-district standardized spring MAP math assessment","basis":"measured","quote":"students at or above the threshold of 2 problems solved per week scored 0.109 SD higher on the within-district standardized spring NWEA MAP math assessment.","url":"https://edworkingpapers.com/sites/default/files/ai26-1611.pdf"},"later":null,"value":null,"developer_country":"United States","deployer_country":"United States","unrated_because":null,"brief_notes":null,"brief":null,"revisions":[{"date":"2026-11-01","change":"Added the record from the report of Alam, Dominguez-Mel and Liu.","source":"https://edworkingpapers.com/ai26-1611","editor":"AIBD"}],"confidence":"claimed","shade":"low","claim_status":"The makers' claim","claim_basis":"Sources: the makers' press release and the evaluators' report. The cited evidence includes no independent source and no finding by an external body.","case_jurisdictions":["United States"],"profile":{"case_id":"AIBD-1153","catalog_version":"1.0.0","source_fingerprint":"ac1c287d78a9919a93663bca4480ba8d0cf4e6b4863c4addf637240578625d72","collection_refs":[{"collection_id":"aibd","version":"2026-10-31"}],"source_ids":["AIBD-1153-source-0001","AIBD-1153-source-0002"],"families":{"strategic assessments":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"evaluations":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"monetary observations":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"institutional decisions":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]}},"fields":{"actors[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"developer":"Aha Moments, Inc. (Goblins)","deployer":"Deer Valley Unified School District, which offered Goblins to all middle-school math teachers in 2025-26"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["developer","deployer"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"actors[].ownership_control":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"ai_contribution":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"ai_relationship":{"state":"value_present","value":{"kind":"record_fields","fields":{"category":"aggregate result","ai_role":{"status":"unassessed","statement":"The study compares heavier and lighter users weighted to look alike on observed traits, so unmeasured differences may remain. It measures use of the whole platform, and teachers could switch off the AI tutor, so the AI tutor's share is unknown."}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ai_role","category"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].alternatives":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].assessor_date":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].depth":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"personal","depth":2,"reason":"Students who solved at least two problems a week scored 0.109 standard deviations higher on spring MAP math than similar students, in an observational comparison."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].display_confidence":{"state":"value_present","value":{"kind":"structured","data":{"confidence":"low","evidence_word":"claimed","claim_status":"The makers' claim","basis":"Sources: the makers' press release and the evaluators' report. The cited evidence includes no independent source and no finding by an external body.","interpretation":"Existing display rule preserved; the richer outcome-specific confidence question still needs review."}},"provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].rationale":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"personal","depth":2,"reason":"Students who solved at least two problems a week scored 0.109 standard deviations higher on spring MAP math than similar students, in an observational comparison."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].rubric_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].status_basis":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].target":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"personal","depth":2,"reason":"Students who solved at least two problems a week scored 0.109 standard deviations higher on spring MAP math than similar students, in an observational comparison."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"availability":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"brief":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"case_kind":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"case_links[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].evidence_links":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].evidence_strength":{"state":"value_present","value":{"kind":"structured","data":{"answer":"The makers' claim. Sources: the makers' press release and the evaluators' report. The cited evidence includes no independent source and no finding by an external body.","evidence_word":"claimed","claim_status":"The makers' claim"}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-1153-source-0001","AIBD-1153-source-0002"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"The makers' claim. Sources: the makers' press release and the evaluators' report. The cited evidence includes no independent source and no finding by an external body.","inferred":false}},"claims[].missingness":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].proposition":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"cross_border_flows[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"decisions[].action_outcome":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].grounds":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].institution_task":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].success_criterion":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"deployment_stage":{"state":"value_present","value":{"kind":"structured","data":{"classification":"routine use","answer":"The system was in routine use. Deer Valley offered Goblins to all middle-school math teachers for the 2025-26 school year.","scope":"The period and activity described in the case."}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["account","evidence"],"source_refs":["AIBD-1153-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"The system was in routine use. Deer Valley offered Goblins to all middle-school math teachers for the 2025-26 school year.","inferred":false}},"economics[].amount":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].costs[]":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].counterfactual":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].currency_price_basis":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].gross_net":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].measure_type":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].period_unit":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].realization":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].recipient_payer":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].return_payback":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].valuation_method":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"evaluations[].ai_uplift":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].comparator":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].design":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].effect":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].exposure":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].id":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].measurement_method":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].metric":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].reproduction_materials":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].setting_sample":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].uncertainty_limitations":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"external_references[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"registry_ids":{"osf":"5kwbp"}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["registry_ids"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"follow_up[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"human_oversight":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"id":{"state":"value_present","value":{"kind":"record_fields","fields":{"id":"AIBD-1153"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["id"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"infrastructure_dependencies[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].beneficiaries":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].beneficiary_count":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].benefit_type":{"state":"value_present","value":{"kind":"record_fields","fields":{"benefit_type":"Improved Learning"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["benefit_type"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].claim":{"state":"value_present","value":{"kind":"record_fields","fields":{"account":"Aha Moments built Goblins, a math platform on which students type, draw or speak while an AI tutor gives step-by-step feedback. Deer Valley Unified School District in Arizona offered it to all middle-school math teachers in the 2025-26 school year. Researchers at the University of Maryland compared 6,065 students in grades 6 to 8, weighting them by propensity scores. They found that students who solved at least two problems a week scored 0.109 standard deviations higher on the spring MAP math test. Students who solved 20 or more problems a week scored 0.31 standard deviations higher, but only 164 students reached that level. Accelerate, a nonprofit that also funds Goblins as a grantee, paid for the study. The authors caution that students chose how much to use Goblins, so unmeasured differences may explain part of the gain. Teachers could switch off the AI tutor, so the estimates cover use of the platform in general. The paper appeared as an EdWorkingPaper in October 2026.","benefit_type":"Improved Learning"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["account","benefit_type"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].distribution":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].duration":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].id":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].stakeholder_group":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"personal","depth":2,"reason":"Students who solved at least two problems a week scored 0.109 standard deviations higher on spring MAP math than similar students, in an observational comparison."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].status":{"state":"value_present","value":{"kind":"record_fields","fields":{"benefit_status":"reported"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["benefit_status"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].tradeoffs":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].unexpected":{"state":"value_present","value":{"kind":"record_fields","fields":{"unexpected":false,"purpose":"Aha Moments built Goblins to give students step-by-step AI tutoring and feedback on math problems that their teachers assign."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["unexpected","purpose"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"places[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"location":"Deer Valley Unified School District, Arizona, United States","developer_country":"United States","deployer_country":"United States"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["location","developer_country","deployer_country"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"purpose":{"state":"value_present","value":{"kind":"record_fields","fields":{"purpose":"Aha Moments built Goblins to give students step-by-step AI tutoring and feedback on math problems that their teachers assign."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["purpose"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"record_dates":{"state":"value_present","value":{"kind":"record_fields","fields":{"date_observed":"2026-01-01","date_basis":"event","date_precision":"year","revisions":[{"date":"2026-11-01","change":"Added the record from the report of Alam, Dominguez-Mel and Liu.","source":"https://edworkingpapers.com/ai26-1611","editor":"AIBD"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["date_observed","date_basis","date_precision","revisions"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"replication.attempts[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"replication.conditions":{"state":"value_present","value":{"kind":"record_fields","fields":{"replication":{"produced_by":["Teachers activated licenses, created classes and assigned content, and they could switch the AI tutor on or off.","Goblins provided professional development for district teachers and instructional leaders in fall 2025.","Students could speak, draw or type their work, with support in seven languages."],"must_hold":["Students must use the platform regularly, and only 50.9% solved at least two problems a week.","Teachers must enroll students in classes on the platform, since students had access only through teacher-created classes."],"echoes":[]}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["replication"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"revision_history[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"revisions":[{"date":"2026-11-01","change":"Added the record from the report of Alam, Dominguez-Mel and Liu.","source":"https://edworkingpapers.com/ai26-1611","editor":"AIBD"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["revisions"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sector":{"state":"value_present","value":{"kind":"record_fields","fields":{"domain":"Education"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["domain"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].access_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"sources[].citation_locator":{"state":"value_present","value":{"kind":"record_fields","fields":{"evidence":[{"kind":"report","citation":"Alam A, Dominguez-Mel N, Liu J (Center for Educational Data Science and Innovation, University of Maryland, College Park). Teacher-Mediated Multimodal Platform and Math Achievement: Evidence from Goblins' Yearlong District Implementation. EdWorkingPaper 26-1611, Annenberg Institute at Brown University, October 2026. doi:10.26300/vcdh-yc23. Funded by Accelerate. Pre-analysis plan at osf.io/5kwbp.","title":"Teacher-Mediated Multimodal Platform and Math Achievement: Evidence from Goblins' Yearlong District Implementation","url":"https://edworkingpapers.com/ai26-1611","date":"2026-10-07","written_by":"evaluator","quote":"Using a weighted propensity design, we find that Goblins usage is associated with a 0.11 standard deviation increase in MAP math scores within the district"},{"kind":"press release","citation":"Accelerate. Can an AI Tutor Help Middle Schoolers Learn Math? What a Study of Goblins Among 6,000+ Students Found. Blog post, 7 October 2026. Accelerate funds Goblins as a grantee of its Call for Effective Technology program and commissioned the study.","title":"Can an AI Tutor Help Middle Schoolers Learn Math? What a Study of Goblins Among 6,000+ Students Found","url":"https://accelerate.us/can-an-ai-tutor-help-middle-schoolers-learn-math/","date":"2026-10-07","written_by":"makers","quote":"middle school students who solved at least two problems a week on Goblins scored about 0.11 standard deviations (SDs) higher on MAP math assessments than similar students who had little or no usage, equivalent to nearly three months of additional learning."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].id":{"state":"value_present","value":{"kind":"identifiers","identifiers":["AIBD-1153-source-0001","AIBD-1153-source-0002"],"role":"Existing evidence items, in their original order"},"provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"complete"},"sources[].language":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"sources[].relationship":{"state":"value_present","value":{"kind":"record_fields","fields":{"evidence":[{"kind":"report","citation":"Alam A, Dominguez-Mel N, Liu J (Center for Educational Data Science and Innovation, University of Maryland, College Park). Teacher-Mediated Multimodal Platform and Math Achievement: Evidence from Goblins' Yearlong District Implementation. EdWorkingPaper 26-1611, Annenberg Institute at Brown University, October 2026. doi:10.26300/vcdh-yc23. Funded by Accelerate. Pre-analysis plan at osf.io/5kwbp.","title":"Teacher-Mediated Multimodal Platform and Math Achievement: Evidence from Goblins' Yearlong District Implementation","url":"https://edworkingpapers.com/ai26-1611","date":"2026-10-07","written_by":"evaluator","quote":"Using a weighted propensity design, we find that Goblins usage is associated with a 0.11 standard deviation increase in MAP math scores within the district"},{"kind":"press release","citation":"Accelerate. Can an AI Tutor Help Middle Schoolers Learn Math? What a Study of Goblins Among 6,000+ Students Found. Blog post, 7 October 2026. Accelerate funds Goblins as a grantee of its Call for Effective Technology program and commissioned the study.","title":"Can an AI Tutor Help Middle Schoolers Learn Math? What a Study of Goblins Among 6,000+ Students Found","url":"https://accelerate.us/can-an-ai-tutor-help-middle-schoolers-learn-math/","date":"2026-10-07","written_by":"makers","quote":"middle school students who solved at least two problems a week on Goblins scored about 0.11 standard deviations (SDs) higher on MAP math assessments than similar students who had little or no usage, equivalent to nearly three months of additional learning."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].upstream_sources":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"strategic_assessments[]":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"strategic assessments"},"summary":{"state":"value_present","value":{"kind":"record_fields","fields":{"summary":"In Arizona's Deer Valley district in 2025-26, middle-school students who solved at least two problems a week on Goblins scored 0.109 standard deviations higher on MAP math than similar students.","account":"Aha Moments built Goblins, a math platform on which students type, draw or speak while an AI tutor gives step-by-step feedback. Deer Valley Unified School District in Arizona offered it to all middle-school math teachers in the 2025-26 school year. Researchers at the University of Maryland compared 6,065 students in grades 6 to 8, weighting them by propensity scores. They found that students who solved at least two problems a week scored 0.109 standard deviations higher on the spring MAP math test. Students who solved 20 or more problems a week scored 0.31 standard deviations higher, but only 164 students reached that level. Accelerate, a nonprofit that also funds Goblins as a grantee, paid for the study. The authors caution that students chose how much to use Goblins, so unmeasured differences may explain part of the gain. Teachers could switch off the AI tutor, so the estimates cover use of the platform in general. The paper appeared as an EdWorkingPaper in October 2026."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["summary","account"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"systems[].autonomy_permissions":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].component_role":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].deployment_configuration":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].inputs_outputs":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].model_name":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].model_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].product_name":{"state":"value_present","value":{"kind":"record_fields","fields":{"system":"Goblins, a teacher-mediated multimodal AI math platform"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["system"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"systems[].provider":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"taxonomy_crosswalks[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"title":{"state":"value_present","value":{"kind":"record_fields","fields":{"title":"University of Maryland researchers find that Arizona middle-schoolers who used the Goblins AI math platform scored 0.11 SD higher on MAP math","headline":"*Goblins* AI math platform users score higher in an Arizona district"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["title","headline"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"version":{"state":"value_present","value":{"kind":"identifiers","identifiers":["adec9a67c41dcc75692717ddeecd9447b2adcb274afae48e8ef9faa043f77318"],"role":"SHA-256 of the complete public record and its assessments"},"provenance":{"kind":"curatorial","basis":"SHA-256 of the public record, its assessments, and its displayed answers and notes, excluding its own identifier and the derived coverage summary.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"complete"},"workflow":{"state":"value_present","value":{"kind":"record_fields","fields":{"account":"Aha Moments built Goblins, a math platform on which students type, draw or speak while an AI tutor gives step-by-step feedback. Deer Valley Unified School District in Arizona offered it to all middle-school math teachers in the 2025-26 school year. Researchers at the University of Maryland compared 6,065 students in grades 6 to 8, weighting them by propensity scores. They found that students who solved at least two problems a week scored 0.109 standard deviations higher on the spring MAP math test. Students who solved 20 or more problems a week scored 0.31 standard deviations higher, but only 164 students reached that level. Accelerate, a nonprofit that also funds Goblins as a grantee, paid for the study. The authors caution that students chose how much to use Goblins, so unmeasured differences may explain part of the gain. Teachers could switch off the AI tutor, so the estimates cover use of the platform in general. The paper appeared as an EdWorkingPaper in October 2026.","replication":{"produced_by":["Teachers activated licenses, created classes and assigned content, and they could switch the AI tutor on or off.","Goblins provided professional development for district teachers and instructional leaders in fall 2025.","Students could speak, draw or type their work, with support in seven languages."],"must_hold":["Students must use the platform regularly, and only 50.9% solved at least two problems a week.","Teachers must enroll students in classes on the platform, since students had access only through teacher-created classes."],"echoes":[]}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["account","replication"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"}},"summary":{"total":91,"addressed":91,"known":29,"reviewed":2,"reviewed_complete":2,"reviewed_partial":0,"record_mapped":27,"review_not_assessed":62,"not_assessed":0,"complete":false,"by_state":{"value_present":29,"not_reported":0,"unresolved":62,"not_assessed":0,"not_applicable":0,"withheld":0,"source_unavailable":0}}},"presentation_version":"016acbd0e4a7445669280e9c3127a42aee7d75153ab8a15b71354a451b26ea3e"}