Benefits
- Benefit
-
The ChatGPT-4 group scored 22.8 against 19.24 (p = 0.005, Cohen's d = 0.58)
Awaiting review
- Outcome identifiers
-
Unresolved
Not reviewedUnresolved
- Category
-
Improved Learning
Awaiting review
- Status
-
Reported benefit
Awaiting review
- Beneficiary groups
-
People.
Awaiting review
- Beneficiaries
-
Unresolved
Not reviewedUnresolved
- Reach
-
Unresolved
Not reviewedUnresolved
- Distribution and access
-
Unresolved
Not reviewedUnresolved
- Duration
-
Unresolved
Not reviewedUnresolved
- Expected?
-
Yes
Awaiting review
- Costs and harms
-
Unresolved
Not reviewedUnresolved
AI system
- System
-
ChatGPT-4, used to deliver AI-driven personalized learning pathways on the acute abdomen topic
Awaiting review
- Model
-
This is an explicit unresolved assignment: the sources on record do not settle this question.
Not reviewedUnresolved
- Reported configuration
-
GPT-4 (ChatGPT-4)
Awaiting review
- Provider
-
Unresolved
Not reviewedUnresolved
- Role
-
Unresolved
Not reviewedUnresolved
- Configuration
-
Unresolved
Not reviewedUnresolved
- Inputs and outputs
-
Unresolved
Not reviewedUnresolved
- Autonomy
-
Unresolved
Not reviewedUnresolved
- Workflow
-
Students worked through ChatGPT-4 learning pathways on one defined surgical topic. Faculty set the topic within the general surgery course.
Awaiting review
- Human oversight
-
Unresolved
Not reviewedUnresolved
- Relation to AI
-
Students were randomly assigned to learning with ChatGPT-4 or with conventional resources on the same topic, so the difference reflects the ChatGPT-4 learning pathways.
Awaiting review
- AI contribution
-
Students were randomly assigned to learning with ChatGPT-4 or with conventional resources on the same topic, so the difference reflects the ChatGPT-4 learning pathways.
Awaiting review
Measurement
- Studies
-
Randomized. [1]
Fully reviewed: supporting details for Studies
Review date: 29 October 2026.
Sources: [1]
- Study design
-
Randomized. [1]
Fully reviewed: supporting details for Study design
Review date: 29 October 2026.
Sources: [1]
- Measurement
-
Topic-specific pre-test and post-test. [1]
Fully reviewed: supporting details for Measurement
Review date: 29 October 2026.
Sources: [1]
- Setting and sample
-
100 fourth-year medical students, Islamic International Medical College, February to July 2024. [1]
Fully reviewed: supporting details for Setting and sample
Review date: 29 October 2026.
Sources: [1]
- Measures
-
Post-test score. [1]
Fully reviewed: supporting details for Measures
Review date: 29 October 2026.
Sources: [1]
- Comparison
-
Conventional educational resources. [1]
Fully reviewed: supporting details for Comparison
Review date: 29 October 2026.
Sources: [1]
- Results
-
22.8 against 19.24 (Cohen's d = 0.58, p = 0.005). [1]
Fully reviewed: supporting details for Results
Review date: 29 October 2026.
Sources: [1]
- Additional value from AI
-
The difference is attributed to the ChatGPT-4 learning pathways. [1]
Fully reviewed: supporting details for Additional value from AI
Review date: 29 October 2026.
Sources: [1]
- Limitations
-
Single institution; one topic; short-term outcome; two-hour exposure; no formal washout between crossover phases; scores were similar after crossover. [1]
Fully reviewed: supporting details for Limitations
Review date: 29 October 2026.
Sources: [1]
Money
- Kind of value
-
The kind of monetary value is unclear.
Not reviewedUnresolved
- Amount
-
The monetary value is not established.
Not reviewedUnresolved
- Currency and prices
-
The currency and price basis are unclear.
Not reviewedUnresolved
- Period and unit
-
The period and unit of the monetary estimate are unclear.
Not reviewedUnresolved
- Realization
-
Whether the monetary value was realized is unclear.
Not reviewedUnresolved
- Recipients and payers
-
The recipients and payers are unclear.
Not reviewedUnresolved
- Gross or net
-
Whether the monetary figure includes costs is unclear.
Not reviewedUnresolved
- Included costs
-
The costs included in the estimate are unclear.
Not reviewedUnresolved
- Comparison
-
The financial comparison is not established.
Not reviewedUnresolved
- Method
-
The method used to calculate monetary value is unclear.
Not reviewedUnresolved
- Return and payback
-
The return on investment or payback period is not established.
Not reviewedUnresolved
People and places
- Participants
-
Developer:
OpenAI. Operator: Islamic International Medical College, Riphah International University (general surgery course).Awaiting review
- Jurisdictions
-
Benefit: Islamic International Medical College, Riphah International University,
Pakistan. Developer: 
United States. Operator: Pakistan.Awaiting review
- Ownership and control
-
Unresolved
Not reviewedUnresolved
- Dependencies
-
Unresolved
Not reviewedUnresolved
- Cross-border connections
-
Unresolved
Not reviewedUnresolved
- Geopolitical implications
-
The geopolitical implications are unclear.
Not reviewedUnresolved
Follow-up
- Conditions for replication
-
Students need access to ChatGPT-4. The content must stay within the course's defined objectives.
Awaiting review
- Replication attempts
-
Unresolved
Not reviewedUnresolved
- Later findings
-
Unresolved
Not reviewedUnresolved
- Availability
-
Unresolved
Not reviewedUnresolved
- Institutional decision
-
A relevant institutional decision has not been established.
Not reviewedUnresolved
- Grounds
-
The grounds for an institutional decision are unclear.
Not reviewedUnresolved
- Action and result
-
The result of an institutional decision is not established.
Not reviewedUnresolved
- Success criterion
-
The criterion for a successful institutional decision is unclear.
Not reviewedUnresolved
Evidence
- Source numbers
-
AIBD-0619-source-0001
Awaiting review
- Citations
-
Numbered references below.
Awaiting review
- Language
-
Unresolved
Not reviewedUnresolved
- Source relationships
-
Independent
Awaiting review
- Original evidence
-
Unresolved
Not reviewedUnresolved
- Access and versions
-
Unresolved
Not reviewedUnresolved
- Supported findings
-
Unresolved
Not reviewedUnresolved
- Evidence links
-
Unresolved
Not reviewedUnresolved
- Evidence strength
-
Independently studied. Sources: one independent peer-reviewed study. The cited evidence includes no finding by a regulator or court. [1]
Fully reviewed: supporting details for Evidence strength
Review date: 29 October 2026.
Sources: [1]
- Missing evidence
-
Unresolved
Not reviewedUnresolved
Grades
- Assessed benefits
-
People.
Awaiting review
- Depth
-
People: 2.
Awaiting review
- Reasons
-
People: Students in the ChatGPT-4 group scored 22.8 against 19.24 on the acute abdomen post-test, a moderate effect (Cohen's d = 0.58).
Awaiting review
- Observed or intended
-
Unresolved
Not reviewedUnresolved
- Rubric
-
Unresolved
Not reviewedUnresolved
- Assessor and date
-
Unresolved
Not reviewedUnresolved
- Alternative assessments
-
Unresolved
Not reviewedUnresolved
- Fill
-
Independently studied
Awaiting review
Entry details
- Kind
-
The case describes an evaluation or a study. The case is a randomized crossover trial. [1]
Fully reviewed: supporting details for Kind
Review date: 29 October 2026.
Sources: [1]
- Related entries
-
No incident in the AI Incident Database snapshot of 26 October 2026 concerns the same kind of system harming the same kind of stakeholder.
Partly reviewedUnresolved: supporting details for Related entries
Compared with the incidents in the AI Incident Database snapshot of 26 October 2026.
- Field
-
Education.
Awaiting review
- Purpose
-
ChatGPT-4 is a general-purpose chatbot. The faculty used it to give students personalized learning pathways, and higher test scores were the purpose of the trial.
Awaiting review
- Dates
-
Observed: July 2024. Updated: 29 October 2026.
Awaiting review
- Stage
-
The system was used in a pilot. ChatGPT-4 was used for one topic within one course during a trial. [1]
Fully reviewed: supporting details for Stage
Review date: 29 October 2026.
Sources: [1]
- Version
-
SHA-256: 6430ca5ea135…
Awaiting review: supporting details for Version
SHA-256 of the public case, its assessments, and its displayed answers and notes, excluding its own identifier and the derived coverage summary.
References
- Other identifiers
-
Unresolved
Not reviewedUnresolved
- Category mappings
-
Unresolved
Not reviewedUnresolved
- Citable summary
-
Unresolved
Not reviewedUnresolved
- Revisions
-
1 revision. Latest: 29 October 2026.
Awaiting review
Sources
-
Peer-reviewed study Independent author
Ilyas M, Khan RA, Yasmeen R, Kamal Z, Ain NU. Impact of ChatGPT-assisted personalized learning on teaching acute abdomen to undergraduate medical students: A randomized crossover study. Pak J Med Sci. 2026;42(8). doi:10.12669/pjms.42.8.14827
Post-intervention, the experimental group showed a statistically significant improvement (M = 22.8, SD = 5.11) compared to the control group (M = 19.24, SD = 7.11), with a p-value of .005 and a moderate effect size (Cohen's d = 0.58).