{"id":"AIBD-0724","title":"The What Works Clearinghouse finds that the ITSS tutor has positive effects on reading comprehension in two randomized trials with 6,724 students","summary":"The What Works Clearinghouse rates ITSS as having positive effects on comprehension. Across two randomized studies with 6,724 students in grades 4, 5 and 7, the improvement index was +9.","date_observed":"2010-01-01","date_basis":"event","date_precision":"year","benefit_status":"reported","source_collection":null,"source_entry":null,"account":"Web-Based Intelligent Tutoring for the Structure Strategy (ITSS) teaches students to use the structure of factual texts to understand and recall them. An animated Intelligent Tutor explains each structure, gives immediate feedback and offers hints after failed attempts. In an intervention report of April 2020, revised in April 2021, the What Works Clearinghouse reviewed two cluster randomized trials. They took place in rural and suburban schools in two states, with students in grades 4 and 5 in 2009-10 and grade 7 in 2010-11. The clearinghouse found a statistically significant positive effect on comprehension in both studies. The clearinghouse rated the effect positive, which it describes as strong evidence of a positive effect. The improvement index was +9 percentile points across 6,724 students. Kausalai Wijekumar, whom the report lists as the program's contact, was first author of both studies. In the second study, random assignment was compromised because students who used ITSS for under 30 minutes were excluded. The report describes the tutor's feedback and hints but does not describe a model trained on data.","category":"aggregate result","unexpected":false,"purpose":"The ITSS developers, led by Kausalai Wijekumar, built ITSS to teach students in grades K-8 to follow the structure of factual texts to improve understanding and recall.","system":"Web-Based Intelligent Tutoring for the Structure Strategy (ITSS)","model_version":null,"developer":"ITSS developers led by Kausalai Wijekumar (contact at Texas A&M University)","deployer":"Rural and suburban schools in two US states (grades 4, 5 and 7) in the two rated studies","location":"United States (two states that the report does not name)","domain":"Education","segment":null,"benefit_type":"Improved Learning","work_activities":["4.A.4.b.3","4.A.2.a.1"],"taxonomy_note":null,"registry_ids":{},"ratings":[{"group":"personal","depth":2,"reason":"Across the two studies, the improvement index for comprehension was +9 percentile points for 6,724 students."}],"ai_role":{"status":"assessed","statement":"Both trials randomly assigned classrooms to ITSS or to the usual language arts curriculum, with equal instruction time. The comparison groups had no structure strategy instruction, so the trials do not separate the tutor's feedback from the strategy it teaches. The report does not describe a model trained on data."},"evidence":[{"kind":"assessment report","citation":"What Works Clearinghouse, Institute of Education Sciences, U.S. Department of Education. Web-Based Intelligent Tutoring for the Structure Strategy (ITSS). Intervention Report, Adolescent Literacy Topic Area, NCEE 2020-009. April 2020, revised April 2021.","title":"WWC Intervention Report: Web-Based Intelligent Tutoring for the Structure Strategy (ITSS)","url":"https://ies.ed.gov/ncee/WWC/Docs/InterventionReports/wwc_ALitss_IR_apr2020.pdf","date":null,"written_by":"independent","quote":"The WWC determined that one study that meets WWC group design standards without reservations and one study that meets WWC group design standards with reservations showed evidence of a positive and statistically significant effect of ITSS on comprehension (Wijekumar et al., 2012, 2017)."}],"replication":{"produced_by":["Students used ITSS on computers with earphones for 30 to 45 minutes a week over 6 to 7 months.","ITSS partly replaced the regular language arts curriculum, with total instruction time unchanged.","The research team trained the teachers of intervention classrooms."],"must_hold":["Teachers and administrators attend the professional development that the developers require.","Students have computer access in class."],"echoes":[]},"paired_incident":null,"headline":"*ITSS* tutoring software raises reading comprehension in two trials","metric":"The improvement index was +9 percentile points","comparator":{"against":"Classrooms using the usual language arts curriculum","before":null,"after":"Improvement index of +9 percentile points","basis":"measured","quote":"For example, an improvement index of +9 means that the expected percentile rank of the average comparison group student would increase by 9 points if the student received ITSS.","url":"https://ies.ed.gov/ncee/WWC/Docs/InterventionReports/wwc_ALitss_IR_apr2020.pdf"},"later":null,"value":null,"developer_country":"United States","deployer_country":"United States","unrated_because":null,"brief_notes":null,"brief":null,"revisions":[{"date":"2026-10-31","change":"Added the record from the finding of the What Works Clearinghouse.","source":"https://ies.ed.gov/ncee/WWC/Docs/InterventionReports/wwc_ALitss_IR_apr2020.pdf","editor":"AIBD"}],"confidence":"found","shade":"high","claim_status":"Found by an assessment body","claim_basis":"Sources: one independent assessment report. The cited evidence includes no independent study or report.","case_jurisdictions":["United States"],"profile":{"case_id":"AIBD-0724","catalog_version":"1.0.0","source_fingerprint":"63d6eb305802ae4592d47b404f0ec38a9a189567bed51eaf41a42a286bef29f8","collection_refs":[{"collection_id":"aibd","version":"2026-10-31"},{"collection_id":"querist","version":"2026-10-25"}],"source_ids":["AIBD-0724-source-0001"],"families":{"strategic assessments":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"evaluations":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"monetary observations":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"institutional decisions":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]}},"fields":{"actors[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"developer":"ITSS developers led by Kausalai Wijekumar (contact at Texas A&M University)","deployer":"Rural and suburban schools in two US states (grades 4, 5 and 7) in the two rated studies"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["developer","deployer"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"actors[].ownership_control":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"ai_contribution":{"state":"value_present","value":{"kind":"record_fields","fields":{"ai_role":{"status":"assessed","statement":"Both trials randomly assigned classrooms to ITSS or to the usual language arts curriculum, with equal instruction time. The comparison groups had no structure strategy instruction, so the trials do not separate the tutor's feedback from the strategy it teaches. The report does not describe a model trained on data."}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ai_role"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"ai_relationship":{"state":"value_present","value":{"kind":"record_fields","fields":{"category":"aggregate result","ai_role":{"status":"assessed","statement":"Both trials randomly assigned classrooms to ITSS or to the usual language arts curriculum, with equal instruction time. The comparison groups had no structure strategy instruction, so the trials do not separate the tutor's feedback from the strategy it teaches. The report does not describe a model trained on data."}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ai_role","category"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].alternatives":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].assessor_date":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].depth":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"personal","depth":2,"reason":"Across the two studies, the improvement index for comprehension was +9 percentile points for 6,724 students."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].display_confidence":{"state":"value_present","value":{"kind":"structured","data":{"confidence":"high","evidence_word":"found","claim_status":"Found by an assessment body","basis":"Sources: one independent assessment report. The cited evidence includes no independent study or report.","interpretation":"Existing display rule preserved; the richer outcome-specific confidence question still needs review."}},"provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].rationale":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"personal","depth":2,"reason":"Across the two studies, the improvement index for comprehension was +9 percentile points for 6,724 students."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].rubric_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].status_basis":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].target":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"personal","depth":2,"reason":"Across the two studies, the improvement index for comprehension was +9 percentile points for 6,724 students."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"availability":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"brief":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"case_kind":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"case_links[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].evidence_links":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].evidence_strength":{"state":"value_present","value":{"kind":"structured","data":{"answer":"Found by an assessment body. Sources: one independent assessment report. The cited evidence includes no independent study or report.","evidence_word":"found","claim_status":"Found by an assessment body"}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0724-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Found by an assessment body. Sources: one independent assessment report. The cited evidence includes no independent study or report.","inferred":false}},"claims[].missingness":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].proposition":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"cross_border_flows[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"decisions[].action_outcome":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].grounds":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].institution_task":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].success_criterion":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"deployment_stage":{"state":"value_present","value":{"kind":"structured","data":{"classification":"pilot","answer":"The system was used in a pilot. ITSS ran in volunteer classrooms within two randomized trials in 2009-10 and 2010-11.","scope":"The period and activity described in the case."}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["account","evidence"],"source_refs":["AIBD-0724-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"The system was used in a pilot. ITSS ran in volunteer classrooms within two randomized trials in 2009-10 and 2010-11.","inferred":false}},"economics[].amount":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].costs[]":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].counterfactual":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].currency_price_basis":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].gross_net":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].measure_type":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].period_unit":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].realization":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].recipient_payer":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].return_payback":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].valuation_method":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"evaluations[].ai_uplift":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].comparator":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].design":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].effect":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].exposure":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].id":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].measurement_method":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].metric":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].reproduction_materials":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].setting_sample":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].uncertainty_limitations":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"external_references[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"follow_up[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"human_oversight":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"id":{"state":"value_present","value":{"kind":"record_fields","fields":{"id":"AIBD-0724"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["id"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"infrastructure_dependencies[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].beneficiaries":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].beneficiary_count":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].benefit_type":{"state":"value_present","value":{"kind":"record_fields","fields":{"benefit_type":"Improved Learning"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["benefit_type"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].claim":{"state":"value_present","value":{"kind":"record_fields","fields":{"account":"Web-Based Intelligent Tutoring for the Structure Strategy (ITSS) teaches students to use the structure of factual texts to understand and recall them. An animated Intelligent Tutor explains each structure, gives immediate feedback and offers hints after failed attempts. In an intervention report of April 2020, revised in April 2021, the What Works Clearinghouse reviewed two cluster randomized trials. They took place in rural and suburban schools in two states, with students in grades 4 and 5 in 2009-10 and grade 7 in 2010-11. The clearinghouse found a statistically significant positive effect on comprehension in both studies. The clearinghouse rated the effect positive, which it describes as strong evidence of a positive effect. The improvement index was +9 percentile points across 6,724 students. Kausalai Wijekumar, whom the report lists as the program's contact, was first author of both studies. In the second study, random assignment was compromised because students who used ITSS for under 30 minutes were excluded. The report describes the tutor's feedback and hints but does not describe a model trained on data.","benefit_type":"Improved Learning"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["account","benefit_type"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].distribution":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].duration":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].id":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].stakeholder_group":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"personal","depth":2,"reason":"Across the two studies, the improvement index for comprehension was +9 percentile points for 6,724 students."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].status":{"state":"value_present","value":{"kind":"record_fields","fields":{"benefit_status":"reported"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["benefit_status"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].tradeoffs":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].unexpected":{"state":"value_present","value":{"kind":"record_fields","fields":{"unexpected":false,"purpose":"The ITSS developers, led by Kausalai Wijekumar, built ITSS to teach students in grades K-8 to follow the structure of factual texts to improve understanding and recall."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["unexpected","purpose"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"places[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"location":"United States (two states that the report does not name)","developer_country":"United States","deployer_country":"United States"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["location","developer_country","deployer_country"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"purpose":{"state":"value_present","value":{"kind":"record_fields","fields":{"purpose":"The ITSS developers, led by Kausalai Wijekumar, built ITSS to teach students in grades K-8 to follow the structure of factual texts to improve understanding and recall."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["purpose"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"record_dates":{"state":"value_present","value":{"kind":"record_fields","fields":{"date_observed":"2010-01-01","date_basis":"event","date_precision":"year","revisions":[{"date":"2026-10-31","change":"Added the record from the finding of the What Works Clearinghouse.","source":"https://ies.ed.gov/ncee/WWC/Docs/InterventionReports/wwc_ALitss_IR_apr2020.pdf","editor":"AIBD"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["date_observed","date_basis","date_precision","revisions"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"replication.attempts[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"replication.conditions":{"state":"value_present","value":{"kind":"record_fields","fields":{"replication":{"produced_by":["Students used ITSS on computers with earphones for 30 to 45 minutes a week over 6 to 7 months.","ITSS partly replaced the regular language arts curriculum, with total instruction time unchanged.","The research team trained the teachers of intervention classrooms."],"must_hold":["Teachers and administrators attend the professional development that the developers require.","Students have computer access in class."],"echoes":[]}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["replication"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"revision_history[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"revisions":[{"date":"2026-10-31","change":"Added the record from the finding of the What Works Clearinghouse.","source":"https://ies.ed.gov/ncee/WWC/Docs/InterventionReports/wwc_ALitss_IR_apr2020.pdf","editor":"AIBD"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["revisions"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sector":{"state":"value_present","value":{"kind":"record_fields","fields":{"domain":"Education"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["domain"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].access_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"sources[].citation_locator":{"state":"value_present","value":{"kind":"record_fields","fields":{"evidence":[{"kind":"assessment report","citation":"What Works Clearinghouse, Institute of Education Sciences, U.S. Department of Education. Web-Based Intelligent Tutoring for the Structure Strategy (ITSS). Intervention Report, Adolescent Literacy Topic Area, NCEE 2020-009. April 2020, revised April 2021.","title":"WWC Intervention Report: Web-Based Intelligent Tutoring for the Structure Strategy (ITSS)","url":"https://ies.ed.gov/ncee/WWC/Docs/InterventionReports/wwc_ALitss_IR_apr2020.pdf","written_by":"independent","quote":"The WWC determined that one study that meets WWC group design standards without reservations and one study that meets WWC group design standards with reservations showed evidence of a positive and statistically significant effect of ITSS on comprehension (Wijekumar et al., 2012, 2017)."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].id":{"state":"value_present","value":{"kind":"identifiers","identifiers":["AIBD-0724-source-0001"],"role":"Existing evidence items, in their original order"},"provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"complete"},"sources[].language":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"sources[].relationship":{"state":"value_present","value":{"kind":"record_fields","fields":{"evidence":[{"kind":"assessment report","citation":"What Works Clearinghouse, Institute of Education Sciences, U.S. Department of Education. Web-Based Intelligent Tutoring for the Structure Strategy (ITSS). Intervention Report, Adolescent Literacy Topic Area, NCEE 2020-009. April 2020, revised April 2021.","title":"WWC Intervention Report: Web-Based Intelligent Tutoring for the Structure Strategy (ITSS)","url":"https://ies.ed.gov/ncee/WWC/Docs/InterventionReports/wwc_ALitss_IR_apr2020.pdf","written_by":"independent","quote":"The WWC determined that one study that meets WWC group design standards without reservations and one study that meets WWC group design standards with reservations showed evidence of a positive and statistically significant effect of ITSS on comprehension (Wijekumar et al., 2012, 2017)."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].upstream_sources":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"strategic_assessments[]":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"strategic assessments"},"summary":{"state":"value_present","value":{"kind":"record_fields","fields":{"summary":"The What Works Clearinghouse rates ITSS as having positive effects on comprehension. Across two randomized studies with 6,724 students in grades 4, 5 and 7, the improvement index was +9.","account":"Web-Based Intelligent Tutoring for the Structure Strategy (ITSS) teaches students to use the structure of factual texts to understand and recall them. An animated Intelligent Tutor explains each structure, gives immediate feedback and offers hints after failed attempts. In an intervention report of April 2020, revised in April 2021, the What Works Clearinghouse reviewed two cluster randomized trials. They took place in rural and suburban schools in two states, with students in grades 4 and 5 in 2009-10 and grade 7 in 2010-11. The clearinghouse found a statistically significant positive effect on comprehension in both studies. The clearinghouse rated the effect positive, which it describes as strong evidence of a positive effect. The improvement index was +9 percentile points across 6,724 students. Kausalai Wijekumar, whom the report lists as the program's contact, was first author of both studies. In the second study, random assignment was compromised because students who used ITSS for under 30 minutes were excluded. The report describes the tutor's feedback and hints but does not describe a model trained on data."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["summary","account"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"systems[].autonomy_permissions":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].component_role":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].deployment_configuration":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].inputs_outputs":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].model_name":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].model_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].product_name":{"state":"value_present","value":{"kind":"record_fields","fields":{"system":"Web-Based Intelligent Tutoring for the Structure Strategy (ITSS)"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["system"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"systems[].provider":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"taxonomy_crosswalks[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"title":{"state":"value_present","value":{"kind":"record_fields","fields":{"title":"The What Works Clearinghouse finds that the ITSS tutor has positive effects on reading comprehension in two randomized trials with 6,724 students","headline":"*ITSS* tutoring software raises reading comprehension in two trials"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["title","headline"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"version":{"state":"value_present","value":{"kind":"identifiers","identifiers":["a52ebd2ea54c4d17f98d1e053eb750e8631e7c1b77b41e67f99e910fb0f7c100"],"role":"SHA-256 of the complete public record and its assessments"},"provenance":{"kind":"curatorial","basis":"SHA-256 of the public record, its assessments, and its displayed answers and notes, excluding its own identifier and the derived coverage summary.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"complete"},"workflow":{"state":"value_present","value":{"kind":"record_fields","fields":{"account":"Web-Based Intelligent Tutoring for the Structure Strategy (ITSS) teaches students to use the structure of factual texts to understand and recall them. An animated Intelligent Tutor explains each structure, gives immediate feedback and offers hints after failed attempts. In an intervention report of April 2020, revised in April 2021, the What Works Clearinghouse reviewed two cluster randomized trials. They took place in rural and suburban schools in two states, with students in grades 4 and 5 in 2009-10 and grade 7 in 2010-11. The clearinghouse found a statistically significant positive effect on comprehension in both studies. The clearinghouse rated the effect positive, which it describes as strong evidence of a positive effect. The improvement index was +9 percentile points across 6,724 students. Kausalai Wijekumar, whom the report lists as the program's contact, was first author of both studies. In the second study, random assignment was compromised because students who used ITSS for under 30 minutes were excluded. The report describes the tutor's feedback and hints but does not describe a model trained on data.","replication":{"produced_by":["Students used ITSS on computers with earphones for 30 to 45 minutes a week over 6 to 7 months.","ITSS partly replaced the regular language arts curriculum, with total instruction time unchanged.","The research team trained the teachers of intervention classrooms."],"must_hold":["Teachers and administrators attend the professional development that the developers require.","Students have computer access in class."],"echoes":[]}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["account","replication"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"}},"summary":{"total":91,"addressed":91,"known":29,"reviewed":2,"reviewed_complete":2,"reviewed_partial":0,"record_mapped":27,"review_not_assessed":62,"not_assessed":0,"complete":false,"by_state":{"value_present":29,"not_reported":0,"unresolved":62,"not_assessed":0,"not_applicable":0,"withheld":0,"source_unavailable":0}}},"presentation_version":"95aea893b3917b87ed664d9cbc9c3e019a7e4a57e07301c6ed4b2e059f670543"}