AI system
- System
-
Pounce, built on AdmitHub’s platform. [1]
- Model
-
The authors describe supervised learning with convolutional neural networks and a university-specific knowledge base. [1]
- Release
-
The article does not identify a release number or the deployed network’s weights. [1]
- Provider
-
AdmitHub. [1]
- Role
-
Pounce selected relevant reminders and answered questions about enrollment. [1]
- Configuration
-
The SMS assistant used Georgia State’s student records and knowledge base to tailor messages about unfinished tasks. [1]
- Inputs and outputs
-
Inputs included student questions and completed enrollment tasks. Outputs were text replies, reminders, and requests for staff help. [1]
- Autonomy
-
Pounce sent messages and routine replies automatically. Questions that it could not answer went to university staff. [1]
- Workflow
-
Pounce checked which tasks remained, sent reminders, and answered questions. Counselors handled unresolved questions by email through the platform. [1]
- Human oversight
-
Staff supplied answers and reviewed conversations. Their corrections helped train the system and expand its knowledge base. [1]
- Relation to AI
-
The assistant used machine learning to interpret questions and choose answers. [1]
- AI contribution
-
The trial compared the complete Pounce service with usual enrollment support. It did not isolate machine learning from reminders and staff assistance. [1]
Benefits
- Outcome identifiers
-
Not assessed
- Benefit
-
Pounce increased enrollment among students who had already committed to Georgia State. [1]
- Category
-
Increased access to education. [1]
- Status
-
Observed in a randomized evaluation. [1]
- Beneficiary groups
-
Incoming college students. [1]
- Beneficiaries
-
Admitted students who had already committed to attend Georgia State. [1]
- Reach
-
The trial assigned 7,489 students. The subgroup with the reported enrollment gain contained 1,948 students. [1]
- Distribution and access
-
The effect was concentrated among students already committed to Georgia State. The overall enrollment effect was not statistically significant. [1]
- Duration
-
The outcome was enrollment for fall 2016. The trial did not measure degree completion. [1]
- Expected?
-
Reducing the loss of committed students before enrollment was the intended benefit. [1]
- Costs and harms
-
The service required staff to maintain answers and resolve difficult questions. Students could opt out of messages. [1]
Measurement
- Studies
-
AIBD-0215-E01 [1]
- Study design
-
Students were randomly assigned within groups defined by whether they had already committed to Georgia State. [1]
- Measurement
-
Researchers used university administrative records and National Student Clearinghouse enrollment data. [1]
- Setting and sample
-
There were 3,745 students assigned to Pounce and 3,744 controls. All had a U.S. mobile number and had agreed to receive texts. [1]
- Measures
-
Enrollment, financial-aid tasks, and other requirements for entering college. [1]
- Comparison
-
Georgia State’s usual enrollment support. [1]
- Results
-
In the committed subgroup, enrollment rose by 3.3 percentage points from a control rate of 84.6%. [1]
- Additional value from AI
-
The trial did not separate automated conversation from personalized reminders and counselor support. [1]
- Limitations
-
The gain applies to the committed subgroup at one university. Overall enrollment rose by 1.2 percentage points, which was not statistically significant. [1]
- Denominators
-
Of students assigned to Pounce, 96.2% received texts, 85.1% replied, and 6.6% opted out. [1]
- Materials for replication
-
The article does not link to participant-level data or analysis code. [1]
Money
- Kind of value
-
Platform price and a modeled annual budget. [1]
- Amount
-
The platform cost US$7–15 per student per year, plus staff work. The authors illustrated a Georgia State budget of about US$53,000 a year. [1]
- Currency and prices
-
U.S. dollars at the prices discussed in the 2017 article. A separate price-base year is not given. [1]
- Period and unit
-
Per student per year, or per university year for the illustrative budget. [1]
- Realization
-
The price range and annual budget are estimates, not an audited statement of Georgia State’s payments. [1]
- Recipients and payers
-
Universities pay for the platform and contribute staff time. [1]
- Gross or net
-
The figures are costs. The paper does not give a measured net financial benefit. [1]
- Included costs
-
The subscription excludes staff time for setup, monitoring, and answers that require a counselor. [1]
- Comparison
-
The authors compare the price with earlier counseling and text-message interventions. Those programs were not cost arms in this trial. [1]
- Method
-
The illustrative annual budget applies a US$15 per-student price. Additional tuition income is discussed but not quantified. [1]
- Return and payback
-
The authors suggest that added tuition would exceed the platform cost, but they do not publish a return or payback calculation. [1]
People and places
- Participants
-
AdmitHub built the assistant, Georgia State provided student information and counseling, and academic researchers evaluated enrollment. [1]
- Jurisdictions
-
Georgia State University in Atlanta, Georgia,
United States. [1] - Ownership and control
-
AdmitHub supplied the platform. Georgia State supplied its institutional knowledge and student records. [1]
- Dependencies
-
The service needed SMS access, current student records, a maintained knowledge base, and counselors for unresolved questions. [1]
- Cross-border connections
-
The trial involved a U.S. university and students with U.S. mobile numbers. It does not document international data transfers. [1]
- Geopolitical implications
-
Not assessed
Follow-up
- Conditions for replication
-
Universities need accurate task records, students who can receive texts, and staff who can answer unresolved questions. [1]
- Replication attempts
-
Two later Georgia State trials reported 5–6 percentage-point increases in grades of B or higher. Their courses and students differed from this enrollment trial. [3]
- Later findings
-
Later Pounce trials addressed coursework rather than summer enrollment and reported improved course grades. [3]
- Availability
-
Not assessed
- Institutional decision
-
Not assessed
- Grounds
-
Not assessed
- Action and result
-
Not assessed
- Success criterion
-
Not assessed
Evidence
- Citations
-
The 2017 trial supplies the enrollment findings and system description. WABE adds a student’s firsthand account. A later paper concerns coursework. [1] [2] [3]
- Source relationships
-
The trial was conducted with the developer and university. WABE’s student interview adds independent reporting, while its trial figures come from the original paper. [1] [2] [3]
- Original evidence
-
The enrollment findings originate in the 2017 trial. WABE adds a student’s account, and the later paper evaluates coursework. [1] [2] [3]
- Access and versions
-
The published enrollment article and WABE’s original report were read. The later course study was inspected only through its title page and abstract. [1] [2] [3]
- Supported findings
-
Pounce helped already-committed students complete enrollment. [1]
- Evidence strength
-
A peer-reviewed randomized trial supports the subgroup effect. [1]
- Missing evidence
-
Not assessed
Grades
Entry details
- Kind
-
A randomized evaluation of text-message support for admitted students. [1]
- Related entries
-
Not assessed
- Field
-
Higher education. [1]
- Purpose
-
Pounce helped admitted students complete the steps required to enroll. [1]
- Dates
-
Messages ran from April through August 2016. The study measured enrollment that fall. [1]
- Stage
-
Georgia State used Pounce for incoming students during summer 2016. [1]
- Version
-
SHA-256: 67e54baea04d…
References
- Other identifiers
-
Not assessed
- Category mappings
-
Not assessed
- Brief
-
Not assessed
- Revisions
-
6 revisions. Latest: 25 October 2026.
Sources
-
Peer-reviewed study Independent author
Original randomized study, participant counts, system mechanism, enrollment effects, and cost estimates. pp. 2–5; Tables 3–6; p. 9; nn. 7 and 16.
Primary evaluation by academic researchers in collaboration with AdmitHub and Georgia State University.
Access copy, supplement, or earlier version of the same work. Published 12-page article. Published 12-page article.
Access copy, supplement, or earlier version of the same work.
-
News report Independent author
Dalton, Martha. “Georgia State Uses a Chatbot to Attack ‘Summer Melt.’” WABE, June 14, 2018.
Firsthand testimony about an enrollment problem that Pounce and staff helped resolve. Austin Birchell’s account and discussion of the mistaken Social Security number.
Independent reporting with a named student’s testimony. Its trial statistics derive from P1.
-
Preprint Independent author
Meyer, Katharine, Lindsay C. Page, Catherine Mata, Eric Smith, B. Tyler Walsh, C. Lindsey Fifield, Amy Eremionkhale, Michael Evans, and Shelby Frost. “Let’s Chat: Leveraging Chatbot Outreach for Improved Course Performance.” EdWorkingPaper 22-564, revised September 2023.
Two later course-specific trials at Georgia State, distinct from summer enrollment. Title page and abstract.
Primary research on later Pounce applications with a different task and population.