AI system
- System
-
Microsoft Copilot (GPT-4) used as a virtual English tutor in teacher-guided after-school computer-lab sessions
- Model
-
GPT-4 within Microsoft Copilot.
- Release
-
Exact release not established.
- Application developer
-
Microsoft (Copilot), on 
OpenAI's GPT-4 - Role
-
Copilot provided English-language tutoring in sessions supervised by teachers.
- Configuration
-
Researchers used GPT-4 through Microsoft Copilot.
- Inputs and outputs
-
Not assessed
- Autonomy
-
Not assessed
- Workflow
-
A freely available LLM (Copilot on GPT-4) requiring only student registration. Curriculum-aligned prompts and activities guided by teachers in school computer labs. Student-level randomization among volunteers in nine schools with computer labs.
- Human oversight
-
Not assessed
- Relation to AI
-
Copilot tutored in teacher-guided sessions, so the estimate covers the whole after-school program (twelve 90-minute sessions). The large language model (LLM) share is not isolated from teacher guidance and extra teaching time.
- AI contribution
-
Copilot tutored in teacher-guided sessions, so the estimate covers the whole after-school program (twelve 90-minute sessions). The large language model (LLM) share is not isolated from teacher guidance and extra teaching time.
Benefits
- Outcome identifiers
-
Not assessed
- Benefit
-
0.31 SD overall, 0.23 SD in English
- Category
-
Improved Learning
- Status
-
Not assessed
- Beneficiary groups
-
People. Organizations.
- Beneficiaries
-
Not assessed
- Reach
-
Not assessed
- Distribution and access
-
Not assessed
- Duration
-
Not assessed
- Expected?
-
Yes
- Costs and harms
-
Not assessed
Measurement
- Studies
-
Not assessed
- Study design
-
Not assessed
- Measurement
-
Not assessed
- Setting and sample
-
Not assessed
- Measures
-
0.31 SD overall, 0.23 SD in English
- Comparison
-
Not assessed
- Results
-
0.31 SD overall, 0.23 SD in English
- Additional value from AI
-
Not assessed
- Limitations
-
Not assessed
- Denominators
-
Not assessed
- Materials for replication
-
Not assessed
Money
- Kind of value
-
Not assessed
- Amount
-
Not assessed
- Currency and prices
-
Not assessed
- Period and unit
-
Not assessed
- Realization
-
Not assessed
- Recipients and payers
-
Not assessed
- Gross or net
-
Not assessed
- Included costs
-
Not assessed
- Comparison
-
Not assessed
- Method
-
Not assessed
- Return and payback
-
Not assessed
People and places
- Participants
-
Developer:
Microsoft (Copilot), on OpenAI's GPT-4. Operator: Nine public secondary schools in Benin City with the World Bank study team; sessions guided by teachers. - Jurisdictions
-
Benefit: Benin City,
Nigeria. Developer: 
United States. Operator: Nigeria. - Ownership and control
-
Not assessed
- Dependencies
-
Not assessed
- Cross-border connections
-
Not assessed
- Geopolitical implications
-
Not assessed
Follow-up
- Conditions for replication
-
Working computer labs and internet access. Teacher guidance in every session. Attendance (the paper reports gains rising with days attended).
- Replication attempts
-
Not assessed
- Later findings
-
No report of a second phase or scale-up of the Benin City program after the May 2025 working paper was found.
- Availability
-
Not assessed
- Institutional decision
-
Not assessed
- Grounds
-
Not assessed
- Action and result
-
Not assessed
- Success criterion
-
Not assessed
Evidence
- Source numbers
-
AIBD-0213-source-0001–0005
- Citations
-
Numbered references below.
- Language
-
Not assessed
- Source relationships
-
Operator
- Original evidence
-
Not assessed
- Access and versions
-
Not assessed
- Supported findings
-
Not assessed
- Evidence links
-
Not assessed
- Evidence strength
-
Not assessed
- Missing evidence
-
Not assessed
Grades
- Assessed benefits
-
People. Organizations.
- Depth
-
Not assessed
- Reasons
-
People: Treated students scored 0.31 SD higher overall and 0.23 SD higher in English after six weeks (working paper abstract). Organizations: The schools and the study team gained a cost-effectiveness estimate of 1.5 to 2 years of business-as-usual schooling (working paper abstract).
- Observed or intended
-
Not assessed
- Rubric
-
Not assessed
- Assessor and date
-
Not assessed
- Alternative assessments
-
Not assessed
- Fill
-
The deployer's account
Entry details
- Kind
-
Not assessed
- Related entries
-
Not assessed
- Field
-
Education. Senior secondary English (after-school program).
- Purpose
-
Copilot was used as a virtual tutor to improve English learning outcomes. The measured gain is that purpose.
- Dates
-
Date basis unassessed: 2024 (precision unassessed). Updated: 21 October 2026.
- Stage
-
Not assessed
- Version
-
SHA-256: e8ff6a381382…
References
- Other identifiers
-
Not assessed
- Category mappings
-
Not assessed
- Brief
-
Not assessed
- Revisions
-
5 revisions. Latest: 21 October 2026.
Sources
-
Report Deployer
De Simone M, Tiberti F, Barron Rodriguez M, Manolio F, Mosuro W, Dikoru EJ (2025). From Chalkboards to Chatbots: Evaluating the Impact of Generative AI on Learning Outcomes in Nigeria. Policy Research Working Paper 11125, World Bank (OKR handle page).
The program was implemented over a six-week period between June and July 2024, targeting first-year senior secondary school students, who are typically 15 years old.
-
Report Deployer
ERIC record ED676624 for Policy Research Working Paper 11125 (abstract).
The intervention demonstrated a significant improvement of 0.31 standard deviation on an assessment that included English topics aligned with the Nigerian curriculum, knowledge of artificial intelligence and digital skills.
-
Report Deployer
De Simone M et al. (2025). Working Paper 11125 (sample and attrition).
However, only 422 students in the treatment group and 337 in the control group completed the final assessment
-
Press release Deployer
De Simone ME, Tiberti F, Mosuro W, Manolio F, Barron M, Dikoru E (9 Jan 2025). From chalkboards to chatbots: Transforming learning in Nigeria, one prompt at a time. World Bank Blogs.
Students who were randomly assigned to participate significantly outperformed peers in all areas
-
Press release Deployer
World Bank Education blog (2024). From chalkboards to chatbots in Nigeria: 7 lessons to pioneer generative AI for education. 18 September 2024.
Over June and July 2024,800 first-year senior secondary students attended after-school English classes in computer labs twice a week.