{"id":"AIBD-0730","title":"Researchers find that Georgia State's Pounce chatbot outreach raised FAFSA filing by enrolled students by two to three points in two randomized trials","summary":"In randomized trials at Georgia State in 2018-19 and 2020-21, chatbot outreach raised FAFSA filing by about 3 points from 59% in Atlanta and by about 2 points from 47% at Perimeter.","date_observed":"2019-01-01","date_basis":"event","date_precision":"year","benefit_status":"reported","source_collection":null,"source_entry":null,"account":"In 2016, Georgia State University contracted with Mainstay to build Pounce, an AI text-message chatbot for admitted students. The university later extended it to enrolled undergraduates. Lindsay Page, Katharine Meyer, Jeonghyun Lee and Hunter Gehlbach evaluated two randomized trials. One covered 13,657 students on the four-year Atlanta campus in 2018-19. The other, pre-registered, covered 11,561 students at the two-year Perimeter College in 2020-21. The university sent tailored messages, such as monthly spring reminders to file the Free Application for Federal Student Aid (FAFSA). The chatbot answered questions from its knowledge base and emailed the rest to university staff. In Atlanta, about 59 percent of control students filed the FAFSA by the end of spring, and treatment students were about three percentage points more likely to file. At Perimeter, filing rose by about two points from 47 percent. Outreach about advising and other supports had little to no effect. The study appeared as an NBER working paper in December 2024 and in the Journal of Research on Educational Effectiveness.","category":"aggregate result","unexpected":false,"purpose":"Mainstay built Pounce for Georgia State University to send students text-message outreach and to answer their questions about administrative tasks.","system":"Pounce, Georgia State University's AI text-message chatbot built by Mainstay","model_version":null,"developer":"Mainstay","deployer":"Georgia State University (Atlanta campus and Perimeter College), through its National Institute for Student Success","location":"Atlanta, Georgia, United States","domain":"Education","segment":null,"benefit_type":"Increased Access to Education","work_activities":["4.A.4.a.3","4.A.4.a.6"],"taxonomy_note":null,"registry_ids":{"sree":"9660"},"ratings":[{"group":"personal","depth":2,"reason":"Students who received the outreach were about two to three percentage points more likely to file the FAFSA by the end of spring."}],"ai_role":{"status":"unassessed","statement":"Students were randomly assigned to receive the outreach or only the usual university messages. The estimate covers the whole service, including messages written by university staff and answers that staff supplied. The share due to the chatbot's automated answers is not isolated."},"evidence":[{"kind":"peer-reviewed study","citation":"Page LC, Meyer KE, Lee J, Gehlbach H. Conditions Under Which College Students Can Be Responsive to Text-Based Nudging. Journal of Research on Educational Effectiveness 19(2):298-326, published online 18 April 2025, doi:10.1080/19345747.2025.2481219. Quoted from NBER Working Paper 33257, December 2024.","title":"Conditions Under Which College Students Can be Responsive to Text-based Nudging","url":"https://www.nber.org/system/files/working_papers/w33257/w33257.pdf","date":null,"written_by":"independent","quote":"About 59 percent of control students in the GSU-Atlanta sample filed the FAFSA by the end of the spring semester, with treatment students about three percentage points more likely to do so."}],"replication":{"produced_by":["The university wrote tailored message campaigns and sent some only to students with a relevant task, such as a registration hold.","The chatbot answered questions that matched its knowledge base and emailed the rest to university staff."],"must_hold":["The task is discrete, required and time-sensitive, like filing the FAFSA.","Messages come from a source that students expect to hear from, such as their university."],"echoes":[]},"paired_incident":null,"headline":"*Pounce* texts help Georgia State students file for financial aid","metric":"about three percentage points more likely to file","comparator":{"against":"Students who received only the usual university communication","before":"About 59 percent filed the FAFSA by the end of spring (GSU-Atlanta control group)","after":"About three percentage points more likely to file","basis":"measured","quote":"About 59 percent of control students in the GSU-Atlanta sample filed the FAFSA by the end of the spring semester, with treatment students about three percentage points more likely to do so.","url":"https://www.nber.org/system/files/working_papers/w33257/w33257.pdf"},"later":null,"value":null,"developer_country":"United States","deployer_country":"United States","unrated_because":null,"brief_notes":null,"brief":null,"revisions":[{"date":"2026-10-31","change":"Added the record from the report of Page, Meyer, Lee and Gehlbach.","source":"https://www.nber.org/system/files/working_papers/w33257/w33257.pdf","editor":"AIBD"}],"confidence":"studied","shade":"high","claim_status":"Independently studied","claim_basis":"Sources: one independent peer-reviewed study. The cited evidence includes no finding by an external body.","case_jurisdictions":["United States"],"profile":{"case_id":"AIBD-0730","catalog_version":"1.0.0","source_fingerprint":"ed66cd018264f9c813a032490602574927e5b8f8c4fb411042858efd724ba885","collection_refs":[{"collection_id":"aibd","version":"2026-10-31"}],"source_ids":["AIBD-0730-source-0001"],"families":{"strategic assessments":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"evaluations":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"monetary observations":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"institutional decisions":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]}},"fields":{"actors[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"developer":"Mainstay","deployer":"Georgia State University (Atlanta campus and Perimeter College), through its National Institute for Student Success"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["developer","deployer"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"actors[].ownership_control":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"ai_contribution":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"ai_relationship":{"state":"value_present","value":{"kind":"record_fields","fields":{"category":"aggregate result","ai_role":{"status":"unassessed","statement":"Students were randomly assigned to receive the outreach or only the usual university messages. The estimate covers the whole service, including messages written by university staff and answers that staff supplied. The share due to the chatbot's automated answers is not isolated."}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ai_role","category"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].alternatives":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].assessor_date":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].depth":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"personal","depth":2,"reason":"Students who received the outreach were about two to three percentage points more likely to file the FAFSA by the end of spring."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].display_confidence":{"state":"value_present","value":{"kind":"structured","data":{"confidence":"high","evidence_word":"studied","claim_status":"Independently studied","basis":"Sources: one independent peer-reviewed study. The cited evidence includes no finding by an external body.","interpretation":"Existing display rule preserved; the richer outcome-specific confidence question still needs review."}},"provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].rationale":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"personal","depth":2,"reason":"Students who received the outreach were about two to three percentage points more likely to file the FAFSA by the end of spring."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].rubric_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].status_basis":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].target":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"personal","depth":2,"reason":"Students who received the outreach were about two to three percentage points more likely to file the FAFSA by the end of spring."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"availability":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"brief":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"case_kind":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"case_links[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].evidence_links":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].evidence_strength":{"state":"value_present","value":{"kind":"structured","data":{"answer":"Independently studied. Sources: one independent peer-reviewed study. The cited evidence includes no finding by an external body.","evidence_word":"studied","claim_status":"Independently studied"}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0730-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Independently studied. Sources: one independent peer-reviewed study. The cited evidence includes no finding by an external body.","inferred":false}},"claims[].missingness":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].proposition":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"cross_border_flows[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"decisions[].action_outcome":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].grounds":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].institution_task":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].success_criterion":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"deployment_stage":{"state":"value_present","value":{"kind":"structured","data":{"classification":"pilot","answer":"The system was used in a pilot. Georgia State tested the chatbot with enrolled students in randomized trials in 2018-19 and 2020-21.","scope":"The period and activity described in the case."}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["account","evidence"],"source_refs":["AIBD-0730-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"The system was used in a pilot. Georgia State tested the chatbot with enrolled students in randomized trials in 2018-19 and 2020-21.","inferred":false}},"economics[].amount":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].costs[]":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].counterfactual":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].currency_price_basis":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].gross_net":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].measure_type":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].period_unit":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].realization":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].recipient_payer":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].return_payback":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].valuation_method":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"evaluations[].ai_uplift":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].comparator":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].design":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].effect":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].exposure":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].id":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].measurement_method":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].metric":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].reproduction_materials":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].setting_sample":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].uncertainty_limitations":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"external_references[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"registry_ids":{"sree":"9660"}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["registry_ids"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"follow_up[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"human_oversight":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"id":{"state":"value_present","value":{"kind":"record_fields","fields":{"id":"AIBD-0730"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["id"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"infrastructure_dependencies[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].beneficiaries":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].beneficiary_count":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].benefit_type":{"state":"value_present","value":{"kind":"record_fields","fields":{"benefit_type":"Increased Access to Education"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["benefit_type"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].claim":{"state":"value_present","value":{"kind":"record_fields","fields":{"account":"In 2016, Georgia State University contracted with Mainstay to build Pounce, an AI text-message chatbot for admitted students. The university later extended it to enrolled undergraduates. Lindsay Page, Katharine Meyer, Jeonghyun Lee and Hunter Gehlbach evaluated two randomized trials. One covered 13,657 students on the four-year Atlanta campus in 2018-19. The other, pre-registered, covered 11,561 students at the two-year Perimeter College in 2020-21. The university sent tailored messages, such as monthly spring reminders to file the Free Application for Federal Student Aid (FAFSA). The chatbot answered questions from its knowledge base and emailed the rest to university staff. In Atlanta, about 59 percent of control students filed the FAFSA by the end of spring, and treatment students were about three percentage points more likely to file. At Perimeter, filing rose by about two points from 47 percent. Outreach about advising and other supports had little to no effect. The study appeared as an NBER working paper in December 2024 and in the Journal of Research on Educational Effectiveness.","benefit_type":"Increased Access to Education"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["account","benefit_type"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].distribution":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].duration":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].id":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].stakeholder_group":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"personal","depth":2,"reason":"Students who received the outreach were about two to three percentage points more likely to file the FAFSA by the end of spring."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].status":{"state":"value_present","value":{"kind":"record_fields","fields":{"benefit_status":"reported"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["benefit_status"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].tradeoffs":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].unexpected":{"state":"value_present","value":{"kind":"record_fields","fields":{"unexpected":false,"purpose":"Mainstay built Pounce for Georgia State University to send students text-message outreach and to answer their questions about administrative tasks."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["unexpected","purpose"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"places[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"location":"Atlanta, Georgia, United States","developer_country":"United States","deployer_country":"United States"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["location","developer_country","deployer_country"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"purpose":{"state":"value_present","value":{"kind":"record_fields","fields":{"purpose":"Mainstay built Pounce for Georgia State University to send students text-message outreach and to answer their questions about administrative tasks."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["purpose"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"record_dates":{"state":"value_present","value":{"kind":"record_fields","fields":{"date_observed":"2019-01-01","date_basis":"event","date_precision":"year","revisions":[{"date":"2026-10-31","change":"Added the record from the report of Page, Meyer, Lee and Gehlbach.","source":"https://www.nber.org/system/files/working_papers/w33257/w33257.pdf","editor":"AIBD"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["date_observed","date_basis","date_precision","revisions"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"replication.attempts[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"replication.conditions":{"state":"value_present","value":{"kind":"record_fields","fields":{"replication":{"produced_by":["The university wrote tailored message campaigns and sent some only to students with a relevant task, such as a registration hold.","The chatbot answered questions that matched its knowledge base and emailed the rest to university staff."],"must_hold":["The task is discrete, required and time-sensitive, like filing the FAFSA.","Messages come from a source that students expect to hear from, such as their university."],"echoes":[]}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["replication"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"revision_history[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"revisions":[{"date":"2026-10-31","change":"Added the record from the report of Page, Meyer, Lee and Gehlbach.","source":"https://www.nber.org/system/files/working_papers/w33257/w33257.pdf","editor":"AIBD"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["revisions"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sector":{"state":"value_present","value":{"kind":"record_fields","fields":{"domain":"Education"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["domain"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].access_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"sources[].citation_locator":{"state":"value_present","value":{"kind":"record_fields","fields":{"evidence":[{"kind":"peer-reviewed study","citation":"Page LC, Meyer KE, Lee J, Gehlbach H. Conditions Under Which College Students Can Be Responsive to Text-Based Nudging. Journal of Research on Educational Effectiveness 19(2):298-326, published online 18 April 2025, doi:10.1080/19345747.2025.2481219. Quoted from NBER Working Paper 33257, December 2024.","title":"Conditions Under Which College Students Can be Responsive to Text-based Nudging","url":"https://www.nber.org/system/files/working_papers/w33257/w33257.pdf","written_by":"independent","quote":"About 59 percent of control students in the GSU-Atlanta sample filed the FAFSA by the end of the spring semester, with treatment students about three percentage points more likely to do so."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].id":{"state":"value_present","value":{"kind":"identifiers","identifiers":["AIBD-0730-source-0001"],"role":"Existing evidence items, in their original order"},"provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"complete"},"sources[].language":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"sources[].relationship":{"state":"value_present","value":{"kind":"record_fields","fields":{"evidence":[{"kind":"peer-reviewed study","citation":"Page LC, Meyer KE, Lee J, Gehlbach H. Conditions Under Which College Students Can Be Responsive to Text-Based Nudging. Journal of Research on Educational Effectiveness 19(2):298-326, published online 18 April 2025, doi:10.1080/19345747.2025.2481219. Quoted from NBER Working Paper 33257, December 2024.","title":"Conditions Under Which College Students Can be Responsive to Text-based Nudging","url":"https://www.nber.org/system/files/working_papers/w33257/w33257.pdf","written_by":"independent","quote":"About 59 percent of control students in the GSU-Atlanta sample filed the FAFSA by the end of the spring semester, with treatment students about three percentage points more likely to do so."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].upstream_sources":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"strategic_assessments[]":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"strategic assessments"},"summary":{"state":"value_present","value":{"kind":"record_fields","fields":{"summary":"In randomized trials at Georgia State in 2018-19 and 2020-21, chatbot outreach raised FAFSA filing by about 3 points from 59% in Atlanta and by about 2 points from 47% at Perimeter.","account":"In 2016, Georgia State University contracted with Mainstay to build Pounce, an AI text-message chatbot for admitted students. The university later extended it to enrolled undergraduates. Lindsay Page, Katharine Meyer, Jeonghyun Lee and Hunter Gehlbach evaluated two randomized trials. One covered 13,657 students on the four-year Atlanta campus in 2018-19. The other, pre-registered, covered 11,561 students at the two-year Perimeter College in 2020-21. The university sent tailored messages, such as monthly spring reminders to file the Free Application for Federal Student Aid (FAFSA). The chatbot answered questions from its knowledge base and emailed the rest to university staff. In Atlanta, about 59 percent of control students filed the FAFSA by the end of spring, and treatment students were about three percentage points more likely to file. At Perimeter, filing rose by about two points from 47 percent. Outreach about advising and other supports had little to no effect. The study appeared as an NBER working paper in December 2024 and in the Journal of Research on Educational Effectiveness."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["summary","account"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"systems[].autonomy_permissions":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].component_role":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].deployment_configuration":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].inputs_outputs":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].model_name":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].model_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].product_name":{"state":"value_present","value":{"kind":"record_fields","fields":{"system":"Pounce, Georgia State University's AI text-message chatbot built by Mainstay"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["system"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"systems[].provider":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"taxonomy_crosswalks[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"title":{"state":"value_present","value":{"kind":"record_fields","fields":{"title":"Researchers find that Georgia State's Pounce chatbot outreach raised FAFSA filing by enrolled students by two to three points in two randomized trials","headline":"*Pounce* texts help Georgia State students file for financial aid"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["title","headline"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"version":{"state":"value_present","value":{"kind":"identifiers","identifiers":["edc1d6e5ee64fef3e4d0c127107641f13fdfb28ecc01d0eb1c0e200b1519cdc0"],"role":"SHA-256 of the complete public record and its assessments"},"provenance":{"kind":"curatorial","basis":"SHA-256 of the public record, its assessments, and its displayed answers and notes, excluding its own identifier and the derived coverage summary.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"complete"},"workflow":{"state":"value_present","value":{"kind":"record_fields","fields":{"account":"In 2016, Georgia State University contracted with Mainstay to build Pounce, an AI text-message chatbot for admitted students. The university later extended it to enrolled undergraduates. Lindsay Page, Katharine Meyer, Jeonghyun Lee and Hunter Gehlbach evaluated two randomized trials. One covered 13,657 students on the four-year Atlanta campus in 2018-19. The other, pre-registered, covered 11,561 students at the two-year Perimeter College in 2020-21. The university sent tailored messages, such as monthly spring reminders to file the Free Application for Federal Student Aid (FAFSA). The chatbot answered questions from its knowledge base and emailed the rest to university staff. In Atlanta, about 59 percent of control students filed the FAFSA by the end of spring, and treatment students were about three percentage points more likely to file. At Perimeter, filing rose by about two points from 47 percent. Outreach about advising and other supports had little to no effect. The study appeared as an NBER working paper in December 2024 and in the Journal of Research on Educational Effectiveness.","replication":{"produced_by":["The university wrote tailored message campaigns and sent some only to students with a relevant task, such as a registration hold.","The chatbot answered questions that matched its knowledge base and emailed the rest to university staff."],"must_hold":["The task is discrete, required and time-sensitive, like filing the FAFSA.","Messages come from a source that students expect to hear from, such as their university."],"echoes":[]}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["account","replication"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"}},"summary":{"total":91,"addressed":91,"known":29,"reviewed":2,"reviewed_complete":2,"reviewed_partial":0,"record_mapped":27,"review_not_assessed":62,"not_assessed":0,"complete":false,"by_state":{"value_present":29,"not_reported":0,"unresolved":62,"not_assessed":0,"not_applicable":0,"withheld":0,"source_unavailable":0}}},"presentation_version":"689a38ad490431fad582e7d7895a907c7937744bf272d5b63bebdaba396e4e76"}