{"id":"AIBD-0619","title":"ChatGPT-4 personalized learning pathways raise fourth-year medical students' acute abdomen post-test scores in a 100-student randomized trial at Islamic International Medical College, Pakistan","summary":"At Islamic International Medical College, Pakistan, 100 students were randomized in 2024; after two hours of study, the ChatGPT-4 group scored 22.8 against 19.24 on an acute abdomen test.","date_observed":"2024-07-01","date_basis":"event","date_precision":"month","benefit_status":"reported","source_collection":null,"source_entry":null,"account":"Maria Ilyas, Rehan Ahmed Khan and colleagues ran a randomized crossover trial from February to July 2024 with 100 fourth-year medical students in the general surgery course at Islamic International Medical College, Riphah International University, Pakistan. After a pre-test, one group of 50 studied the acute abdomen topic for two hours through personalized learning pathways that ChatGPT-4 produced from standard prompts and from a form on each student's study habits. The other group of 50 used conventional resources for the same time. Pre-test scores did not differ significantly, 17.12 in the ChatGPT-4 group and 18.64 in the control group. On the first post-test, the ChatGPT-4 group scored 22.8 against 19.24 (p = 0.005, Cohen's d = 0.58). The groups then switched methods for one more hour, and the scores on a second post-test were similar. The authors note that the trial took place at a single institution on one surgical topic and measured short-term performance, and that it had no formal washout period between phases. The Pakistan Journal of Medical Sciences published the study in August 2026.","category":"general benefit","unexpected":false,"purpose":"ChatGPT-4 is a general-purpose chatbot. The faculty used it to give students personalized learning pathways, and higher test scores were the purpose of the trial.","system":"ChatGPT-4, used to deliver AI-driven personalized learning pathways on the acute abdomen topic","model_version":"GPT-4 (ChatGPT-4)","developer":"OpenAI","deployer":"Islamic International Medical College, Riphah International University (general surgery course)","location":"Islamic International Medical College, Riphah International University, Pakistan","domain":"Education","segment":null,"benefit_type":"Improved Learning","taxonomy_note":null,"registry_ids":{},"ratings":[{"group":"personal","depth":2,"reason":"Students in the ChatGPT-4 group scored 22.8 against 19.24 on the acute abdomen post-test, a moderate effect (Cohen's d = 0.58)."}],"ai_role":{"status":"assessed","statement":"Students were randomly assigned to learning with ChatGPT-4 or with conventional resources on the same topic, so the difference reflects the ChatGPT-4 learning pathways."},"evidence":[{"kind":"peer-reviewed study","citation":"Ilyas M, Khan RA, Yasmeen R, Kamal Z, Ain NU. Impact of ChatGPT-assisted personalized learning on teaching acute abdomen to undergraduate medical students: A randomized crossover study. Pak J Med Sci. 2026;42(8). doi:10.12669/pjms.42.8.14827","title":"Impact of ChatGPT-assisted personalized learning on teaching acute abdomen to undergraduate medical students: A randomized crossover study","url":"https://pmc.ncbi.nlm.nih.gov/articles/PMC13525506/","date":"2026-08-01","written_by":"independent","quote":"Post-intervention, the experimental group showed a statistically significant improvement (M = 22.8, SD = 5.11) compared to the control group (M = 19.24, SD = 7.11), with a p-value of .005 and a moderate effect size (Cohen's d = 0.58)."}],"replication":{"produced_by":["Students worked through ChatGPT-4 learning pathways on one defined surgical topic.","Faculty set the topic within the general surgery course."],"must_hold":["Students need access to ChatGPT-4.","The content must stay within the course's defined objectives."],"echoes":[]},"paired_incident":null,"headline":"*ChatGPT-4* study plans lift Pakistani medical students' surgery scores","metric":"the ChatGPT-4 group scored 22.8 against 19.24 (p = 0.005, Cohen's d = 0.58)","comparator":{"against":"Students using conventional educational resources","before":"Mean post-test score 19.24 (control)","after":"Mean post-test score 22.8 (ChatGPT-4)","basis":"measured","quote":"Post-intervention, the experimental group showed a statistically significant improvement (M = 22.8, SD = 5.11) compared to the control group (M = 19.24, SD = 7.11), with a p-value of .005 and a moderate effect size (Cohen's d = 0.58).","url":"https://pmc.ncbi.nlm.nih.gov/articles/PMC13525506/"},"later":null,"value":null,"developer_country":"United States","deployer_country":"Pakistan","unrated_because":null,"brief_notes":null,"brief":null,"revisions":[{"date":"2026-10-29","change":"Added the case.","source":"https://pmc.ncbi.nlm.nih.gov/articles/PMC13525506/","editor":"AIBD"}],"confidence":"studied","shade":"high","claim_status":"Independently studied","claim_basis":"Sources: one independent peer-reviewed study. The cited evidence includes no finding by a regulator or court.","case_jurisdictions":["Pakistan"],"profile":{"case_id":"AIBD-0619","catalog_version":"1.0.0","source_fingerprint":"b95f4dc30bbe2d089683a7b63e3a41424a76652ade398a907eb8021ea2cbe84f","collection_refs":[{"collection_id":"aibd","version":"2026-10-29"},{"collection_id":"viator","version":"2026-10-25"}],"source_ids":["AIBD-0619-source-0001"],"families":{"strategic assessments":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"evaluations":{"state":"value_present","value":{"kind":"identifiers","identifiers":["AIBD-0619-evaluation-1"],"role":"Evaluations of the benefit"},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":[],"source_refs":["AIBD-0619-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"partial","record_ids":["AIBD-0619-evaluation-1"]},"monetary observations":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"institutional decisions":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]}},"fields":{"actors[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"developer":"OpenAI","deployer":"Islamic International Medical College, Riphah International University (general surgery course)"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["developer","deployer"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"actors[].ownership_control":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"ai_contribution":{"state":"value_present","value":{"kind":"record_fields","fields":{"ai_role":{"status":"assessed","statement":"Students were randomly assigned to learning with ChatGPT-4 or with conventional resources on the same topic, so the difference reflects the ChatGPT-4 learning pathways."}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ai_role"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"ai_relationship":{"state":"value_present","value":{"kind":"record_fields","fields":{"category":"general benefit","ai_role":{"status":"assessed","statement":"Students were randomly assigned to learning with ChatGPT-4 or with conventional resources on the same topic, so the difference reflects the ChatGPT-4 learning pathways."}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ai_role","category"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].alternatives":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].assessor_date":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].depth":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"personal","depth":2,"reason":"Students in the ChatGPT-4 group scored 22.8 against 19.24 on the acute abdomen post-test, a moderate effect (Cohen's d = 0.58)."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].display_confidence":{"state":"value_present","value":{"kind":"structured","data":{"confidence":"high","evidence_word":"studied","claim_status":"Independently studied","basis":"Sources: one independent peer-reviewed study. The cited evidence includes no finding by a regulator or court.","interpretation":"Existing display rule preserved; the richer outcome-specific confidence question still needs review."}},"provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].rationale":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"personal","depth":2,"reason":"Students in the ChatGPT-4 group scored 22.8 against 19.24 on the acute abdomen post-test, a moderate effect (Cohen's d = 0.58)."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].rubric_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].status_basis":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].target":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"personal","depth":2,"reason":"Students in the ChatGPT-4 group scored 22.8 against 19.24 on the acute abdomen post-test, a moderate effect (Cohen's d = 0.58)."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"availability":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"brief":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"case_kind":{"state":"value_present","value":{"kind":"structured","data":{"classification":"evaluation or study","answer":"The case describes an evaluation or a study. The case is a randomized crossover trial.","scope":"The period and activity described in the case."}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["account","evidence"],"source_refs":["AIBD-0619-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"The case describes an evaluation or a study. The case is a randomized crossover trial.","inferred":false}},"case_links[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Compared with the incidents in the AI Incident Database snapshot of 26 October 2026.","record_fields":["paired_incident"],"source_refs":[]},"reason":"No incident in the AI Incident Database snapshot of 26 October 2026 concerns the same kind of system harming the same kind of stakeholder.","review_state":"reviewed","coverage":"partial"},"claims[].evidence_links":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].evidence_strength":{"state":"value_present","value":{"kind":"structured","data":{"answer":"Independently studied. Sources: one independent peer-reviewed study. The cited evidence includes no finding by a regulator or court.","evidence_word":"studied","claim_status":"Independently studied"}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0619-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Independently studied. Sources: one independent peer-reviewed study. The cited evidence includes no finding by a regulator or court.","inferred":false}},"claims[].missingness":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].proposition":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"cross_border_flows[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"decisions[].action_outcome":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].grounds":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].institution_task":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].success_criterion":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"deployment_stage":{"state":"value_present","value":{"kind":"structured","data":{"classification":"pilot","answer":"The system was used in a pilot. ChatGPT-4 was used for one topic within one course during a trial.","scope":"The period and activity described in the case."}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["account","evidence"],"source_refs":["AIBD-0619-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"The system was used in a pilot. ChatGPT-4 was used for one topic within one course during a trial.","inferred":false}},"economics[].amount":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].costs[]":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].counterfactual":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].currency_price_basis":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].gross_net":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].measure_type":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].period_unit":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].realization":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].recipient_payer":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].return_payback":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].valuation_method":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"evaluations[].ai_uplift":{"state":"value_present","value":{"kind":"text","text":"The difference is attributed to the ChatGPT-4 learning pathways."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0619-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"The difference is attributed to the ChatGPT-4 learning pathways.","inferred":false}},"evaluations[].comparator":{"state":"value_present","value":{"kind":"text","text":"Conventional educational resources."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0619-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Conventional educational resources.","inferred":false}},"evaluations[].design":{"state":"value_present","value":{"kind":"text","text":"Randomized."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0619-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Randomized.","inferred":false}},"evaluations[].effect":{"state":"value_present","value":{"kind":"text","text":"22.8 against 19.24 (Cohen's d = 0.58, p = 0.005)."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0619-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"22.8 against 19.24 (Cohen's d = 0.58, p = 0.005).","inferred":false}},"evaluations[].exposure":{"state":"value_present","value":{"kind":"text","text":"Two hours of study on one topic, then one hour with the other method after crossover."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0619-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Two hours of study on one topic, then one hour with the other method after crossover.","inferred":false}},"evaluations[].id":{"state":"value_present","value":{"kind":"identifiers","identifiers":["AIBD-0619-evaluation-1"],"role":"Evaluations of the benefit"},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0619-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Randomized.","inferred":false}},"evaluations[].measurement_method":{"state":"value_present","value":{"kind":"text","text":"Topic-specific pre-test and post-test."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0619-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Topic-specific pre-test and post-test.","inferred":false}},"evaluations[].metric":{"state":"value_present","value":{"kind":"text","text":"Post-test score."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0619-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Post-test score.","inferred":false}},"evaluations[].reproduction_materials":{"state":"unresolved","provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0619-source-0001"],"reviewed_on":"2026-10-29"},"reason":"The evaluation does not state this detail.","review_state":"reviewed","coverage":"partial"},"evaluations[].setting_sample":{"state":"value_present","value":{"kind":"text","text":"100 fourth-year medical students, Islamic International Medical College, February to July 2024."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0619-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"100 fourth-year medical students, Islamic International Medical College, February to July 2024.","inferred":false}},"evaluations[].uncertainty_limitations":{"state":"value_present","value":{"kind":"text","text":"Single institution; one topic; short-term outcome; two-hour exposure; no formal washout between crossover phases; scores were similar after crossover."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0619-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Single institution; one topic; short-term outcome; two-hour exposure; no formal washout between crossover phases; scores were similar after crossover.","inferred":false}},"external_references[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"follow_up[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"human_oversight":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"id":{"state":"value_present","value":{"kind":"record_fields","fields":{"id":"AIBD-0619"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["id"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"infrastructure_dependencies[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].beneficiaries":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].beneficiary_count":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].benefit_type":{"state":"value_present","value":{"kind":"record_fields","fields":{"benefit_type":"Improved Learning"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["benefit_type"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].claim":{"state":"value_present","value":{"kind":"record_fields","fields":{"account":"Maria Ilyas, Rehan Ahmed Khan and colleagues ran a randomized crossover trial from February to July 2024 with 100 fourth-year medical students in the general surgery course at Islamic International Medical College, Riphah International University, Pakistan. After a pre-test, one group of 50 studied the acute abdomen topic for two hours through personalized learning pathways that ChatGPT-4 produced from standard prompts and from a form on each student's study habits. The other group of 50 used conventional resources for the same time. Pre-test scores did not differ significantly, 17.12 in the ChatGPT-4 group and 18.64 in the control group. On the first post-test, the ChatGPT-4 group scored 22.8 against 19.24 (p = 0.005, Cohen's d = 0.58). The groups then switched methods for one more hour, and the scores on a second post-test were similar. The authors note that the trial took place at a single institution on one surgical topic and measured short-term performance, and that it had no formal washout period between phases. The Pakistan Journal of Medical Sciences published the study in August 2026.","benefit_type":"Improved Learning"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["account","benefit_type"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].distribution":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].duration":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].id":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].stakeholder_group":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"personal","depth":2,"reason":"Students in the ChatGPT-4 group scored 22.8 against 19.24 on the acute abdomen post-test, a moderate effect (Cohen's d = 0.58)."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].status":{"state":"value_present","value":{"kind":"record_fields","fields":{"benefit_status":"reported"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["benefit_status"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].tradeoffs":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].unexpected":{"state":"value_present","value":{"kind":"record_fields","fields":{"unexpected":false,"purpose":"ChatGPT-4 is a general-purpose chatbot. The faculty used it to give students personalized learning pathways, and higher test scores were the purpose of the trial."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["unexpected","purpose"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"places[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"location":"Islamic International Medical College, Riphah International University, Pakistan","developer_country":"United States","deployer_country":"Pakistan"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["location","developer_country","deployer_country"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"purpose":{"state":"value_present","value":{"kind":"record_fields","fields":{"purpose":"ChatGPT-4 is a general-purpose chatbot. The faculty used it to give students personalized learning pathways, and higher test scores were the purpose of the trial."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["purpose"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"record_dates":{"state":"value_present","value":{"kind":"record_fields","fields":{"date_observed":"2024-07-01","date_basis":"event","date_precision":"month","revisions":[{"date":"2026-10-29","change":"Added the case.","source":"https://pmc.ncbi.nlm.nih.gov/articles/PMC13525506/","editor":"AIBD"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["date_observed","date_basis","date_precision","revisions"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"replication.attempts[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"replication.conditions":{"state":"value_present","value":{"kind":"record_fields","fields":{"replication":{"produced_by":["Students worked through ChatGPT-4 learning pathways on one defined surgical topic.","Faculty set the topic within the general surgery course."],"must_hold":["Students need access to ChatGPT-4.","The content must stay within the course's defined objectives."],"echoes":[]}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["replication"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"revision_history[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"revisions":[{"date":"2026-10-29","change":"Added the case.","source":"https://pmc.ncbi.nlm.nih.gov/articles/PMC13525506/","editor":"AIBD"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["revisions"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sector":{"state":"value_present","value":{"kind":"record_fields","fields":{"domain":"Education"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["domain"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].access_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"sources[].citation_locator":{"state":"value_present","value":{"kind":"record_fields","fields":{"evidence":[{"kind":"peer-reviewed study","citation":"Ilyas M, Khan RA, Yasmeen R, Kamal Z, Ain NU. Impact of ChatGPT-assisted personalized learning on teaching acute abdomen to undergraduate medical students: A randomized crossover study. Pak J Med Sci. 2026;42(8). doi:10.12669/pjms.42.8.14827","title":"Impact of ChatGPT-assisted personalized learning on teaching acute abdomen to undergraduate medical students: A randomized crossover study","url":"https://pmc.ncbi.nlm.nih.gov/articles/PMC13525506/","date":"2026-08-01","written_by":"independent","quote":"Post-intervention, the experimental group showed a statistically significant improvement (M = 22.8, SD = 5.11) compared to the control group (M = 19.24, SD = 7.11), with a p-value of .005 and a moderate effect size (Cohen's d = 0.58)."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].id":{"state":"value_present","value":{"kind":"identifiers","identifiers":["AIBD-0619-source-0001"],"role":"Existing evidence items, in their original order"},"provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"complete"},"sources[].language":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"sources[].relationship":{"state":"value_present","value":{"kind":"record_fields","fields":{"evidence":[{"kind":"peer-reviewed study","citation":"Ilyas M, Khan RA, Yasmeen R, Kamal Z, Ain NU. Impact of ChatGPT-assisted personalized learning on teaching acute abdomen to undergraduate medical students: A randomized crossover study. Pak J Med Sci. 2026;42(8). doi:10.12669/pjms.42.8.14827","title":"Impact of ChatGPT-assisted personalized learning on teaching acute abdomen to undergraduate medical students: A randomized crossover study","url":"https://pmc.ncbi.nlm.nih.gov/articles/PMC13525506/","date":"2026-08-01","written_by":"independent","quote":"Post-intervention, the experimental group showed a statistically significant improvement (M = 22.8, SD = 5.11) compared to the control group (M = 19.24, SD = 7.11), with a p-value of .005 and a moderate effect size (Cohen's d = 0.58)."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].upstream_sources":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"strategic_assessments[]":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"strategic assessments"},"summary":{"state":"value_present","value":{"kind":"record_fields","fields":{"summary":"At Islamic International Medical College, Pakistan, 100 students were randomized in 2024; after two hours of study, the ChatGPT-4 group scored 22.8 against 19.24 on an acute abdomen test.","account":"Maria Ilyas, Rehan Ahmed Khan and colleagues ran a randomized crossover trial from February to July 2024 with 100 fourth-year medical students in the general surgery course at Islamic International Medical College, Riphah International University, Pakistan. After a pre-test, one group of 50 studied the acute abdomen topic for two hours through personalized learning pathways that ChatGPT-4 produced from standard prompts and from a form on each student's study habits. The other group of 50 used conventional resources for the same time. Pre-test scores did not differ significantly, 17.12 in the ChatGPT-4 group and 18.64 in the control group. On the first post-test, the ChatGPT-4 group scored 22.8 against 19.24 (p = 0.005, Cohen's d = 0.58). The groups then switched methods for one more hour, and the scores on a second post-test were similar. The authors note that the trial took place at a single institution on one surgical topic and measured short-term performance, and that it had no formal washout period between phases. The Pakistan Journal of Medical Sciences published the study in August 2026."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["summary","account"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"systems[].autonomy_permissions":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].component_role":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].deployment_configuration":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].inputs_outputs":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].model_name":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].model_version":{"state":"value_present","value":{"kind":"record_fields","fields":{"model_version":"GPT-4 (ChatGPT-4)"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["model_version"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"systems[].product_name":{"state":"value_present","value":{"kind":"record_fields","fields":{"system":"ChatGPT-4, used to deliver AI-driven personalized learning pathways on the acute abdomen topic"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["system"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"systems[].provider":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"taxonomy_crosswalks[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"title":{"state":"value_present","value":{"kind":"record_fields","fields":{"title":"ChatGPT-4 personalized learning pathways raise fourth-year medical students' acute abdomen post-test scores in a 100-student randomized trial at Islamic International Medical College, Pakistan","headline":"*ChatGPT-4* study plans lift Pakistani medical students' surgery scores"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["title","headline"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"version":{"state":"value_present","value":{"kind":"identifiers","identifiers":["6430ca5ea1351e3b8009378a850c6ddb4f7dd56673fdb85e55653c22b760e029"],"role":"SHA-256 of the complete public case and its assessments"},"provenance":{"kind":"curatorial","basis":"SHA-256 of the public case, its assessments, and its displayed answers and notes, excluding its own identifier and the derived coverage summary.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"complete"},"workflow":{"state":"value_present","value":{"kind":"record_fields","fields":{"account":"Maria Ilyas, Rehan Ahmed Khan and colleagues ran a randomized crossover trial from February to July 2024 with 100 fourth-year medical students in the general surgery course at Islamic International Medical College, Riphah International University, Pakistan. After a pre-test, one group of 50 studied the acute abdomen topic for two hours through personalized learning pathways that ChatGPT-4 produced from standard prompts and from a form on each student's study habits. The other group of 50 used conventional resources for the same time. Pre-test scores did not differ significantly, 17.12 in the ChatGPT-4 group and 18.64 in the control group. On the first post-test, the ChatGPT-4 group scored 22.8 against 19.24 (p = 0.005, Cohen's d = 0.58). The groups then switched methods for one more hour, and the scores on a second post-test were similar. The authors note that the trial took place at a single institution on one surgical topic and measured short-term performance, and that it had no formal washout period between phases. The Pakistan Journal of Medical Sciences published the study in August 2026.","replication":{"produced_by":["Students worked through ChatGPT-4 learning pathways on one defined surgical topic.","Faculty set the topic within the general surgery course."],"must_hold":["Students need access to ChatGPT-4.","The content must stay within the course's defined objectives."],"echoes":[]}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["account","replication"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"}},"summary":{"total":91,"addressed":91,"known":41,"reviewed":15,"reviewed_complete":13,"reviewed_partial":2,"record_mapped":28,"review_not_assessed":48,"not_assessed":0,"complete":false,"by_state":{"value_present":41,"not_reported":0,"unresolved":50,"not_assessed":0,"not_applicable":0,"withheld":0,"source_unavailable":0}}},"presentation_version":"134b63cd0994aa7759efffc4aa04555e5f1acff0d1039d7b427cc627ddc66da7"}