ChatGPT guidance improves dental students' simulated skill scores

In a 2024 randomized trial with 187 dental undergraduates in China, students who used ChatGPT-3.5 with instructional videos scored 73.12 against 65.54 on a virtual reality skills test.

2
Benefit status
Reported
Evidence
Independently studied
Observed
Sources
1 publication
Download data CiteSuggest a correction

Benefits

Benefit

The ChatGPT group scored 73.12 against 65.54 for the video-only group (P < .001)

Awaiting review

Outcome identifiers

Unresolved

Not reviewedUnresolved

Category

Improved Learning

Awaiting review

Status

Reported benefit

Awaiting review

Beneficiary groups

People.

Awaiting review

Beneficiaries

Unresolved

Not reviewedUnresolved

Reach

Unresolved

Not reviewedUnresolved

Distribution and access

Unresolved

Not reviewedUnresolved

Duration

Unresolved

Not reviewedUnresolved

Expected?

Yes

Awaiting review

Costs and harms

Unresolved

Not reviewedUnresolved

AI system

System

ChatGPT-3.5 (free version), used to answer questions and check procedural steps during dental skill learning

Awaiting review

Model

This is an explicit unresolved assignment: the sources on record do not settle this question.

Not reviewedUnresolved

Reported configuration

ChatGPT-3.5 (free version)

Awaiting review

Provider

Unresolved

Not reviewedUnresolved

Role

Unresolved

Not reviewedUnresolved

Configuration

Unresolved

Not reviewedUnresolved

Inputs and outputs

Unresolved

Not reviewedUnresolved

Autonomy

Unresolved

Not reviewedUnresolved

Workflow

Students could ask ChatGPT about doubts during a week of video-based skill learning. The group received written guidelines on using ChatGPT before the study.

Awaiting review

Human oversight

Unresolved

Not reviewedUnresolved

Relation to AI

Students were randomly assigned to videos with ChatGPT or videos alone, so the difference reflects the added ChatGPT support. The comparison group received no other added support.

Awaiting review

AI contribution

Students were randomly assigned to videos with ChatGPT or videos alone, so the difference reflects the added ChatGPT support. The comparison group received no other added support.

Awaiting review

Measurement

Studies

Randomized. [1]

Fully reviewed

Review date: 29 October 2026.

Sources: [1]

Study design

Randomized. [1]

Fully reviewed

Review date: 29 October 2026.

Sources: [1]

Measurement

Operational skill score on a desktop virtual reality simulator; pupil diameter for cognitive load; questionnaires. [1]

Fully reviewed

Review date: 29 October 2026.

Sources: [1]

Setting and sample

187 undergraduate dental students at a Chinese university, October to November 2024. [1]

Fully reviewed

Review date: 29 October 2026.

Sources: [1]

Measures

Operational performance score. [1]

Fully reviewed

Review date: 29 October 2026.

Sources: [1]

Comparison

Video-only learning. [1]

Fully reviewed

Review date: 29 October 2026.

Sources: [1]

Results

73.12 against 65.54 (P < .001). [1]

Fully reviewed

Review date: 29 October 2026.

Sources: [1]

Additional value from AI

The gain is attributed to adding ChatGPT to video learning. [1]

Fully reviewed

Review date: 29 October 2026.

Sources: [1]

Limitations

One-week intervention; comparison group had no added support; accuracy of ChatGPT answers not checked; simulated test. [1]

Fully reviewed

Review date: 29 October 2026.

Sources: [1]

Denominators

One week of skill learning. [1]

Fully reviewed

Review date: 29 October 2026.

Sources: [1]

Materials for replication

ClinicalTrials.gov NCT06942130. [1]

Fully reviewed

Review date: 29 October 2026.

Sources: [1]

Money

Kind of value

The kind of monetary value is unclear.

Not reviewedUnresolved

Amount

The monetary value is not established.

Not reviewedUnresolved

Currency and prices

The currency and price basis are unclear.

Not reviewedUnresolved

Period and unit

The period and unit of the monetary estimate are unclear.

Not reviewedUnresolved

Realization

Whether the monetary value was realized is unclear.

Not reviewedUnresolved

Recipients and payers

The recipients and payers are unclear.

Not reviewedUnresolved

Gross or net

Whether the monetary figure includes costs is unclear.

Not reviewedUnresolved

Included costs

The costs included in the estimate are unclear.

Not reviewedUnresolved

Comparison

The financial comparison is not established.

Not reviewedUnresolved

Method

The method used to calculate monetary value is unclear.

Not reviewedUnresolved

Return and payback

The return on investment or payback period is not established.

Not reviewedUnresolved

People and places

Participants

Developer: OpenAI. Operator: School and Hospital of Stomatology, Wuhan University (study team).

Awaiting review

Jurisdictions

Benefit: China (a university that the paper does not name; the authors are at Wuhan University). Developer: United States. Operator: China.

Awaiting review

Ownership and control

Unresolved

Not reviewedUnresolved

Dependencies

Unresolved

Not reviewedUnresolved

Cross-border connections

Unresolved

Not reviewedUnresolved

Geopolitical implications

The geopolitical implications are unclear.

Not reviewedUnresolved

Follow-up

Conditions for replication

Students need access to ChatGPT during practice. Instructors should check the accuracy of the answers that students receive.

Awaiting review

Replication attempts

Unresolved

Not reviewedUnresolved

Later findings

Unresolved

Not reviewedUnresolved

Availability

Unresolved

Not reviewedUnresolved

Institutional decision

A relevant institutional decision has not been established.

Not reviewedUnresolved

Grounds

The grounds for an institutional decision are unclear.

Not reviewedUnresolved

Action and result

The result of an institutional decision is not established.

Not reviewedUnresolved

Success criterion

The criterion for a successful institutional decision is unclear.

Not reviewedUnresolved

Evidence

Source numbers

AIBD-0620-source-0001

Awaiting review

Citations

Numbered references below.

Awaiting review

Language

Unresolved

Not reviewedUnresolved

Source relationships

Independent

Awaiting review

Original evidence

Unresolved

Not reviewedUnresolved

Access and versions

Unresolved

Not reviewedUnresolved

Supported findings

Unresolved

Not reviewedUnresolved

Evidence strength

Independently studied. Sources: one independent peer-reviewed study. The cited evidence includes no finding by a regulator or court. [1]

Fully reviewed

Review date: 29 October 2026.

Sources: [1]

Missing evidence

Unresolved

Not reviewedUnresolved

Grades

Assessed benefits

People.

Awaiting review

Depth

People: 2.

Awaiting review

Reasons

People: Students with ChatGPT scored 73.12 against 65.54 on the virtual reality skills test, and students with low spatial ability scored 70.20 against 55.41.

Awaiting review

Observed or intended

Unresolved

Not reviewedUnresolved

Rubric

Unresolved

Not reviewedUnresolved

Assessor and date

Unresolved

Not reviewedUnresolved

Alternative assessments

Unresolved

Not reviewedUnresolved

Fill

Independently studied

Awaiting review

Entry details

Kind

The case describes an evaluation or a study. The case is a registered randomized controlled trial (NCT06942130). [1]

Fully reviewed

Review date: 29 October 2026.

Sources: [1]

Field

Education.

Awaiting review

Purpose

ChatGPT is a general-purpose chatbot. The authors tested it as a skills instructor, and better skill performance was the purpose of the trial.

Awaiting review

Dates

Observed: 2 November 2024. Updated: 29 October 2026.

Awaiting review

Stage

The system was used in a pilot. Students used ChatGPT for one week within a trial. [1]

Fully reviewed

Review date: 29 October 2026.

Sources: [1]

Version

SHA-256: 1dc42951ec23…

Awaiting review

SHA-256 of the public case, its assessments, and its displayed answers and notes, excluding its own identifier and the derived coverage summary.

References

Other identifiers

Unresolved

Not reviewedUnresolved

Category mappings

Unresolved

Not reviewedUnresolved

Citable summary

Unresolved

Not reviewedUnresolved

Revisions

1 revision. Latest: 29 October 2026.

Awaiting review

Sources

  1. Peer-reviewed study Independent author

    Huang S, Wen C, Bai X, Li S, Wang S, Wang X, Yang D. Exploring the Application Capability of ChatGPT as an Instructor in Skills Education for Dental Medical Students: Randomized Controlled Trial. J Med Internet Res. 2025;27:e68538. doi:10.2196/68538

Cite this case

BibTeX Download BibTeX

Version 1dc42951ec23, archived in the edition of 29 October 2026

Benefit marks

Depth

The number and color show the depth of a benefit.

  1. A convenience, or time or money saved.
  2. A measurable improvement in a result or ability.
  3. A lasting change, an ability restored, or a risk removed.
  4. A serious harm averted or a serious condition resolved in time.
  5. A life or livelihood preserved, or a change documented across a population.

Beneficiary

  • Circle: a person
  • Square: an organization
  • Triangle: society

Evidence

  • Solid. A court or regulator found a benefit, or researchers independently studied it.

  • Hatched. Independent reporting.

  • Outline. Claimed by the parties. Only the people or organizations involved, or sources whose independence has not been assessed, support the benefit.

The fill changes with the evidence. The depth color stays the same.

How benefits are assessed