More incoming students complete college enrollment

Among students already committed to Georgia State, Pounce increased enrollment by 3.3 percentage points.

AI system

System

Pounce, built on AdmitHub’s platform. [1]

Model

The authors describe supervised learning with convolutional neural networks and a university-specific knowledge base. [1]

Release

The article does not identify a release number or the deployed network’s weights. [1]

Provider

AdmitHub. [1]

Role

Pounce selected relevant reminders and answered questions about enrollment. [1]

Configuration

The SMS assistant used Georgia State’s student records and knowledge base to tailor messages about unfinished tasks. [1]

Inputs and outputs

Inputs included student questions and completed enrollment tasks. Outputs were text replies, reminders, and requests for staff help. [1]

Autonomy

Pounce sent messages and routine replies automatically. Questions that it could not answer went to university staff. [1]

Workflow

Pounce checked which tasks remained, sent reminders, and answered questions. Counselors handled unresolved questions by email through the platform. [1]

Human oversight

Staff supplied answers and reviewed conversations. Their corrections helped train the system and expand its knowledge base. [1]

Relation to AI

The assistant used machine learning to interpret questions and choose answers. [1]

AI contribution

The trial compared the complete Pounce service with usual enrollment support. It did not isolate machine learning from reminders and staff assistance. [1]

Benefits

Outcome identifiers

Not assessed

Benefit

Pounce increased enrollment among students who had already committed to Georgia State. [1]

Category

Increased access to education. [1]

Status

Observed in a randomized evaluation. [1]

Beneficiary groups

Incoming college students. [1]

Beneficiaries

Admitted students who had already committed to attend Georgia State. [1]

Reach

The trial assigned 7,489 students. The subgroup with the reported enrollment gain contained 1,948 students. [1]

Distribution and access

The effect was concentrated among students already committed to Georgia State. The overall enrollment effect was not statistically significant. [1]

Duration

The outcome was enrollment for fall 2016. The trial did not measure degree completion. [1]

Expected?

Reducing the loss of committed students before enrollment was the intended benefit. [1]

Costs and harms

The service required staff to maintain answers and resolve difficult questions. Students could opt out of messages. [1]

Measurement

Studies

AIBD-0215-E01 [1]

Study design

Students were randomly assigned within groups defined by whether they had already committed to Georgia State. [1]

Measurement

Researchers used university administrative records and National Student Clearinghouse enrollment data. [1]

Setting and sample

There were 3,745 students assigned to Pounce and 3,744 controls. All had a U.S. mobile number and had agreed to receive texts. [1]

Measures

Enrollment, financial-aid tasks, and other requirements for entering college. [1]

Comparison

Georgia State’s usual enrollment support. [1]

Results

In the committed subgroup, enrollment rose by 3.3 percentage points from a control rate of 84.6%. [1]

Additional value from AI

The trial did not separate automated conversation from personalized reminders and counselor support. [1]

Limitations

The gain applies to the committed subgroup at one university. Overall enrollment rose by 1.2 percentage points, which was not statistically significant. [1]

Denominators

Of students assigned to Pounce, 96.2% received texts, 85.1% replied, and 6.6% opted out. [1]

Materials for replication

The article does not link to participant-level data or analysis code. [1]

Money

Kind of value

Platform price and a modeled annual budget. [1]

Amount

The platform cost US$7–15 per student per year, plus staff work. The authors illustrated a Georgia State budget of about US$53,000 a year. [1]

Currency and prices

U.S. dollars at the prices discussed in the 2017 article. A separate price-base year is not given. [1]

Period and unit

Per student per year, or per university year for the illustrative budget. [1]

Realization

The price range and annual budget are estimates, not an audited statement of Georgia State’s payments. [1]

Recipients and payers

Universities pay for the platform and contribute staff time. [1]

Gross or net

The figures are costs. The paper does not give a measured net financial benefit. [1]

Included costs

The subscription excludes staff time for setup, monitoring, and answers that require a counselor. [1]

Comparison

The authors compare the price with earlier counseling and text-message interventions. Those programs were not cost arms in this trial. [1]

Method

The illustrative annual budget applies a US$15 per-student price. Additional tuition income is discussed but not quantified. [1]

Return and payback

The authors suggest that added tuition would exceed the platform cost, but they do not publish a return or payback calculation. [1]

People and places

Participants

AdmitHub built the assistant, Georgia State provided student information and counseling, and academic researchers evaluated enrollment. [1]

Jurisdictions

Georgia State University in Atlanta, Georgia, United States. [1]

Ownership and control

AdmitHub supplied the platform. Georgia State supplied its institutional knowledge and student records. [1]

Dependencies

The service needed SMS access, current student records, a maintained knowledge base, and counselors for unresolved questions. [1]

Cross-border connections

The trial involved a U.S. university and students with U.S. mobile numbers. It does not document international data transfers. [1]

Geopolitical implications

Not assessed

Follow-up

Conditions for replication

Universities need accurate task records, students who can receive texts, and staff who can answer unresolved questions. [1]

Replication attempts

Two later Georgia State trials reported 5–6 percentage-point increases in grades of B or higher. Their courses and students differed from this enrollment trial. [3]

Later findings

Later Pounce trials addressed coursework rather than summer enrollment and reported improved course grades. [3]

Availability

Not assessed

Institutional decision

Not assessed

Grounds

Not assessed

Action and result

Not assessed

Success criterion

Not assessed

Evidence

Source numbers

AIBD-0215-source-0001, AIBD-0215-source-0002, AIBD-0215-source-0003 [1] [2] [3]

Citations

The 2017 trial supplies the enrollment findings and system description. WABE adds a student’s firsthand account. A later paper concerns coursework. [1] [2] [3]

Language

English. [1] [2] [3]

Source relationships

The trial was conducted with the developer and university. WABE’s student interview adds independent reporting, while its trial figures come from the original paper. [1] [2] [3]

Original evidence

The enrollment findings originate in the 2017 trial. WABE adds a student’s account, and the later paper evaluates coursework. [1] [2] [3]

Access and versions

The published enrollment article and WABE’s original report were read. The later course study was inspected only through its title page and abstract. [1] [2] [3]

Supported findings

Pounce helped already-committed students complete enrollment. [1]

Evidence strength

A peer-reviewed randomized trial supports the subgroup effect. [1]

Missing evidence

Not assessed

Grades

Assessed benefits

Students’ access to college. [1]

Depth

Personal: 2 [1]

Reasons

More already-committed students completed college enrollment. [1]

Observed or intended

Observed in a randomized evaluation. [1]

Rubric

Not assessed

Assessor and date

Not assessed

Alternative assessments

Not assessed

Fill

Independently studied [1] [2] [3]

Entry details

Kind

A randomized evaluation of text-message support for admitted students. [1]

Field

Higher education. [1]

Purpose

Pounce helped admitted students complete the steps required to enroll. [1]

Dates

Messages ran from April through August 2016. The study measured enrollment that fall. [1]

Stage

Georgia State used Pounce for incoming students during summer 2016. [1]

Version

SHA-256: 67e54baea04d…

References

Other identifiers

Not assessed

Category mappings

Not assessed

Brief

Not assessed

Revisions

6 revisions. Latest: 25 October 2026.

Sources

  1. Peer-reviewed study Independent author

    Page, Lindsay C., and Hunter Gehlbach. AERA Open 3, no. 4 (2017): 1–12. https://doi.org/10.1177/2332858417749220.

    Original randomized study, participant counts, system mechanism, enrollment effects, and cost estimates. pp. 2–5; Tables 3–6; p. 9; nn. 7 and 16.

    Primary evaluation by academic researchers in collaboration with AdmitHub and Georgia State University.

    Access copy, supplement, or earlier version of the same work. Published 12-page article. Published 12-page article.

    Access copy, supplement, or earlier version of the same work.

  2. News report Independent author

    Dalton, Martha. “Georgia State Uses a Chatbot to Attack ‘Summer Melt.’” WABE, June 14, 2018.

    Firsthand testimony about an enrollment problem that Pounce and staff helped resolve. Austin Birchell’s account and discussion of the mistaken Social Security number.

    Independent reporting with a named student’s testimony. Its trial statistics derive from P1.

  3. Preprint Independent author

    Meyer, Katharine, Lindsay C. Page, Catherine Mata, Eric Smith, B. Tyler Walsh, C. Lindsey Fifield, Amy Eremionkhale, Michael Evans, and Shelby Frost. “Let’s Chat: Leveraging Chatbot Outreach for Improved Course Performance.” EdWorkingPaper 22-564, revised September 2023.

    Two later course-specific trials at Georgia State, distinct from summer enrollment. Title page and abstract.

    Primary research on later Pounce applications with a different task and population.