{"id":"AIBD-0666","title":"ChatGPT cuts time on professional writing tasks by 40% and raises graded quality by 18% in a preregistered experiment with 453 professionals (Noy and Zhang, Science)","summary":"In a preregistered experiment with 453 college-educated professionals, ChatGPT cut time on writing tasks by 40% and raised graded quality by 18%.","date_observed":"2023-07-14","date_basis":"source publication","date_precision":"day","benefit_status":"reported","source_collection":null,"source_entry":null,"account":"Shakked Noy and Whitney Zhang, economists at MIT, gave occupation-specific, incentivized writing tasks to 453 college-educated professionals who worked as marketers, grant writers, consultants, data analysts, human resource professionals and managers. Between the first and second task, a random half were told to sign up for ChatGPT and were allowed to use it on the second task. Science published the study in July 2023. The authors report that average time taken fell by 40% and graded output quality rose by 18%. The working paper, with 444 participants, reports that ChatGPT helped low-ability workers most, which narrowed the gap between workers. Participants exposed to ChatGPT were twice as likely to report using it in their real jobs two weeks later and 1.6 times as likely two months later. The tasks were short and self-contained and were written online for pay, so the result shows what the tool did for this kind of writing; the study does not measure output in the participants' own workplaces. An Emergent Ventures grant, the George and Obie Shultz Fund and the National Science Foundation funded the work.","category":"general benefit","unexpected":false,"purpose":"OpenAI built ChatGPT as a general-purpose chatbot. The experiment tested its use for professional writing.","system":"ChatGPT","model_version":null,"developer":"OpenAI","deployer":"MIT researchers (Noy and Zhang), in an online experiment","location":"Online experiment with professionals (the sources do not name the countries)","domain":"Professional writing","segment":null,"benefit_type":"Reduced Task Time","taxonomy_note":null,"registry_ids":{},"ratings":[{"group":"personal","depth":1,"reason":"Participants with ChatGPT finished writing tasks in 40% less time, with quality 18% higher."}],"ai_role":{"status":"assessed","statement":"Access to ChatGPT was randomly assigned for the second task, so the change in time and quality isolates the effect of the tool."},"evidence":[{"kind":"peer-reviewed study","citation":"Noy S, Zhang W. Experimental evidence on the productivity effects of generative artificial intelligence. Science. 2023;381(6654):187-192. doi:10.1126/science.adh2586.","title":"Experimental evidence on the productivity effects of generative artificial intelligence","url":"https://pubmed.ncbi.nlm.nih.gov/37440646/","date":"2023-07-14","written_by":"independent","quote":"Our results show that ChatGPT substantially raised productivity: The average time taken decreased by 40% and output quality rose by 18%."},{"kind":"preprint","citation":"Noy S, Zhang W. Experimental Evidence on the Productivity Effects of Generative Artificial Intelligence. Working paper, MIT, 2 March 2023.","title":"Experimental Evidence on the Productivity Effects of Generative Artificial Intelligence (working paper)","url":"https://economics.mit.edu/sites/default/files/inline-files/Noy_Zhang_1.pdf","date":"2023-03-02","written_by":"independent","quote":"Inequality between workers decreases, as ChatGPT compresses the productivity distribution by benefiting low-ability workers more."}],"replication":{"produced_by":["Professionals wrote short, incentivized documents typical of their occupations.","Half received ChatGPT for the second task after writing the first without it."],"must_hold":["The writing task must be short and self-contained.","Writers must review and edit the model's draft."],"echoes":[{"date":"2023-01-01","setting":"University of Minnesota law students drafting legal documents with GPT-4","model_version":null,"outcome":"recurred","source":"https://doi.org/10.24926/265535.4225"}]},"paired_incident":{"database":"AI Incident Database","identifier":"764","title":"Cody Enterprise Reporter Resigns After Admitting to AI-Generated Fake Quotes","url":"https://incidentdatabase.ai/cite/764","severity":null,"group":"personal","basis":"Both cases concern a professional who uses a generative AI chatbot to draft written work, where the writer is held responsible for false content that the tool produces."},"headline":"*ChatGPT* speeds up everyday professional writing","metric":"cut time on writing tasks by 40% and raised graded quality by 18%","comparator":{"against":"Participants without ChatGPT access","before":"Control group time and graded quality","after":"40% less time, 18% higher quality","basis":"measured","quote":"The average time taken decreased by 40% and output quality rose by 18%.","url":"https://pubmed.ncbi.nlm.nih.gov/37440646/"},"later":null,"value":null,"developer_country":"United States","deployer_country":"United States","unrated_because":null,"brief_notes":null,"brief":null,"revisions":[{"date":"2026-10-29","change":"Added the case.","source":"https://pubmed.ncbi.nlm.nih.gov/37440646/","editor":"AIBD"},{"date":"2026-10-29","change":"Linked a comparable incident in the AI Incident Database (incident 764).","source":"https://incidentdatabase.ai/cite/764","editor":"AIBD"}],"confidence":"studied","shade":"high","claim_status":"Independently studied","claim_basis":"Sources: one independent peer-reviewed study and one independent preprint. The cited evidence includes no finding by a regulator or court.","case_jurisdictions":[],"profile":{"case_id":"AIBD-0666","catalog_version":"1.0.0","source_fingerprint":"e01ad6fa7ca3d5a385836d7b5be048ee5935e409359080a24bea0676605b91f9","collection_refs":[{"collection_id":"aibd","version":"2026-10-29"}],"source_ids":["AIBD-0666-source-0001","AIBD-0666-source-0002"],"families":{"strategic assessments":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"evaluations":{"state":"value_present","value":{"kind":"identifiers","identifiers":["AIBD-0666-evaluation-1"],"role":"Evaluations of the benefit"},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":[],"source_refs":["AIBD-0666-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"partial","record_ids":["AIBD-0666-evaluation-1"]},"monetary observations":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"institutional decisions":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]}},"fields":{"actors[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"developer":"OpenAI","deployer":"MIT researchers (Noy and Zhang), in an online experiment"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["developer","deployer"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"actors[].ownership_control":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"ai_contribution":{"state":"value_present","value":{"kind":"record_fields","fields":{"ai_role":{"status":"assessed","statement":"Access to ChatGPT was randomly assigned for the second task, so the change in time and quality isolates the effect of the tool."}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ai_role"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"ai_relationship":{"state":"value_present","value":{"kind":"record_fields","fields":{"category":"general benefit","ai_role":{"status":"assessed","statement":"Access to ChatGPT was randomly assigned for the second task, so the change in time and quality isolates the effect of the tool."}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ai_role","category"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].alternatives":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].assessor_date":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].depth":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"personal","depth":1,"reason":"Participants with ChatGPT finished writing tasks in 40% less time, with quality 18% higher."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].display_confidence":{"state":"value_present","value":{"kind":"structured","data":{"confidence":"high","evidence_word":"studied","claim_status":"Independently studied","basis":"Sources: one independent peer-reviewed study and one independent preprint. The cited evidence includes no finding by a regulator or court.","interpretation":"Existing display rule preserved; the richer outcome-specific confidence question still needs review."}},"provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].rationale":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"personal","depth":1,"reason":"Participants with ChatGPT finished writing tasks in 40% less time, with quality 18% higher."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].rubric_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].status_basis":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].target":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"personal","depth":1,"reason":"Participants with ChatGPT finished writing tasks in 40% less time, with quality 18% higher."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"availability":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"brief":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"case_kind":{"state":"value_present","value":{"kind":"structured","data":{"classification":"evaluation or study","answer":"The case describes an evaluation or a study. A preregistered randomized experiment.","scope":"The period and activity described in the case."}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["account","evidence"],"source_refs":["AIBD-0666-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"The case describes an evaluation or a study. A preregistered randomized experiment.","inferred":false}},"case_links[]":{"state":"value_present","value":{"kind":"structured","data":{"answer":"Both cases concern a professional who uses a generative AI chatbot to draft written work, where the writer is held responsible for false content that the tool produces.","links":[{"database":"AI Incident Database","identifier":"764","title":"Cody Enterprise Reporter Resigns After Admitting to AI-Generated Fake Quotes","url":"https://incidentdatabase.ai/cite/764","group":"personal","basis":"Both cases concern a professional who uses a generative AI chatbot to draft written work, where the writer is held responsible for false content that the tool produces.","relation":"comparable_harm"}]}},"provenance":{"kind":"curatorial","basis":"Compared with the incidents in the AI Incident Database snapshot of 26 October 2026; a second reading confirmed that the incident concerns the same kind of system and stakeholder.","record_fields":["paired_incident"],"source_refs":["https://incidentdatabase.ai/cite/764"]},"review_state":"reviewed","coverage":"complete","display":{"answer":"Both cases concern a professional who uses a generative AI chatbot to draft written work, where the writer is held responsible for false content that the tool produces.","inferred":false}},"claims[].evidence_links":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].evidence_strength":{"state":"value_present","value":{"kind":"structured","data":{"answer":"Independently studied. Sources: one independent peer-reviewed study and one independent preprint. The cited evidence includes no finding by a regulator or court.","evidence_word":"studied","claim_status":"Independently studied"}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0666-source-0001","AIBD-0666-source-0002"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Independently studied. Sources: one independent peer-reviewed study and one independent preprint. The cited evidence includes no finding by a regulator or court.","inferred":false}},"claims[].missingness":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].proposition":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"cross_border_flows[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"decisions[].action_outcome":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].grounds":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].institution_task":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].success_criterion":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"deployment_stage":{"state":"value_present","value":{"kind":"structured","data":{"classification":"laboratory test","answer":"The system was tested in a laboratory. An online experiment with designed tasks.","scope":"The period and activity described in the case."}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["account","evidence"],"source_refs":["AIBD-0666-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"The system was tested in a laboratory. An online experiment with designed tasks.","inferred":false}},"economics[].amount":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].costs[]":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].counterfactual":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].currency_price_basis":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].gross_net":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].measure_type":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].period_unit":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].realization":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].recipient_payer":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].return_payback":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].valuation_method":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"evaluations[].ai_uplift":{"state":"value_present","value":{"kind":"text","text":"40% faster with 18% higher quality."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0666-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"40% faster with 18% higher quality.","inferred":false}},"evaluations[].comparator":{"state":"value_present","value":{"kind":"text","text":"Participants without ChatGPT."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0666-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Participants without ChatGPT.","inferred":false}},"evaluations[].design":{"state":"value_present","value":{"kind":"text","text":"Randomized."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0666-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Randomized.","inferred":false}},"evaluations[].effect":{"state":"value_present","value":{"kind":"text","text":"Time down 40%, quality up 18%."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0666-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Time down 40%, quality up 18%.","inferred":false}},"evaluations[].exposure":{"state":"value_present","value":{"kind":"text","text":"ChatGPT access for one writing task."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0666-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"ChatGPT access for one writing task.","inferred":false}},"evaluations[].id":{"state":"value_present","value":{"kind":"identifiers","identifiers":["AIBD-0666-evaluation-1"],"role":"Evaluations of the benefit"},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0666-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Randomized.","inferred":false}},"evaluations[].measurement_method":{"state":"value_present","value":{"kind":"text","text":"Time on task and blinded grades from evaluators in the same occupations."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0666-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Time on task and blinded grades from evaluators in the same occupations.","inferred":false}},"evaluations[].metric":{"state":"value_present","value":{"kind":"text","text":"Time taken and output quality."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0666-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Time taken and output quality.","inferred":false}},"evaluations[].reproduction_materials":{"state":"value_present","value":{"kind":"text","text":"Preregistered at the AEA RCT Registry (AEARCTR-0010882)."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0666-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Preregistered at the AEA RCT Registry (AEARCTR-0010882).","inferred":false}},"evaluations[].setting_sample":{"state":"value_present","value":{"kind":"text","text":"453 college-educated professionals in an online experiment."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0666-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"453 college-educated professionals in an online experiment.","inferred":false}},"evaluations[].uncertainty_limitations":{"state":"value_present","value":{"kind":"text","text":"Short designed tasks completed online; effects on workplace output not measured."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0666-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Short designed tasks completed online; effects on workplace output not measured.","inferred":false}},"external_references[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"paired_incident":{"database":"AI Incident Database","identifier":"764","title":"Cody Enterprise Reporter Resigns After Admitting to AI-Generated Fake Quotes","url":"https://incidentdatabase.ai/cite/764","group":"personal","basis":"Both cases concern a professional who uses a generative AI chatbot to draft written work, where the writer is held responsible for false content that the tool produces."}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["paired_incident"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"follow_up[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"human_oversight":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"id":{"state":"value_present","value":{"kind":"record_fields","fields":{"id":"AIBD-0666"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["id"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"infrastructure_dependencies[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].beneficiaries":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].beneficiary_count":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].benefit_type":{"state":"value_present","value":{"kind":"record_fields","fields":{"benefit_type":"Reduced Task Time"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["benefit_type"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].claim":{"state":"value_present","value":{"kind":"record_fields","fields":{"account":"Shakked Noy and Whitney Zhang, economists at MIT, gave occupation-specific, incentivized writing tasks to 453 college-educated professionals who worked as marketers, grant writers, consultants, data analysts, human resource professionals and managers. Between the first and second task, a random half were told to sign up for ChatGPT and were allowed to use it on the second task. Science published the study in July 2023. The authors report that average time taken fell by 40% and graded output quality rose by 18%. The working paper, with 444 participants, reports that ChatGPT helped low-ability workers most, which narrowed the gap between workers. Participants exposed to ChatGPT were twice as likely to report using it in their real jobs two weeks later and 1.6 times as likely two months later. The tasks were short and self-contained and were written online for pay, so the result shows what the tool did for this kind of writing; the study does not measure output in the participants' own workplaces. An Emergent Ventures grant, the George and Obie Shultz Fund and the National Science Foundation funded the work.","benefit_type":"Reduced Task Time"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["account","benefit_type"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].distribution":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].duration":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].id":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].stakeholder_group":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"personal","depth":1,"reason":"Participants with ChatGPT finished writing tasks in 40% less time, with quality 18% higher."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].status":{"state":"value_present","value":{"kind":"record_fields","fields":{"benefit_status":"reported"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["benefit_status"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].tradeoffs":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].unexpected":{"state":"value_present","value":{"kind":"record_fields","fields":{"unexpected":false,"purpose":"OpenAI built ChatGPT as a general-purpose chatbot. The experiment tested its use for professional writing."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["unexpected","purpose"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"places[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"location":"Online experiment with professionals (the sources do not name the countries)","developer_country":"United States","deployer_country":"United States"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["location","developer_country","deployer_country"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"purpose":{"state":"value_present","value":{"kind":"record_fields","fields":{"purpose":"OpenAI built ChatGPT as a general-purpose chatbot. The experiment tested its use for professional writing."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["purpose"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"record_dates":{"state":"value_present","value":{"kind":"record_fields","fields":{"date_observed":"2023-07-14","date_basis":"source publication","date_precision":"day","revisions":[{"date":"2026-10-29","change":"Added the case.","source":"https://pubmed.ncbi.nlm.nih.gov/37440646/","editor":"AIBD"},{"date":"2026-10-29","change":"Linked a comparable incident in the AI Incident Database (incident 764).","source":"https://incidentdatabase.ai/cite/764","editor":"AIBD"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["date_observed","date_basis","date_precision","revisions"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"replication.attempts[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"replication":{"produced_by":["Professionals wrote short, incentivized documents typical of their occupations.","Half received ChatGPT for the second task after writing the first without it."],"must_hold":["The writing task must be short and self-contained.","Writers must review and edit the model's draft."],"echoes":[{"date":"2023-01-01","setting":"University of Minnesota law students drafting legal documents with GPT-4","outcome":"recurred","source":"https://doi.org/10.24926/265535.4225"}]}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["replication"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"replication.conditions":{"state":"value_present","value":{"kind":"record_fields","fields":{"replication":{"produced_by":["Professionals wrote short, incentivized documents typical of their occupations.","Half received ChatGPT for the second task after writing the first without it."],"must_hold":["The writing task must be short and self-contained.","Writers must review and edit the model's draft."],"echoes":[{"date":"2023-01-01","setting":"University of Minnesota law students drafting legal documents with GPT-4","outcome":"recurred","source":"https://doi.org/10.24926/265535.4225"}]}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["replication"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"revision_history[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"revisions":[{"date":"2026-10-29","change":"Added the case.","source":"https://pubmed.ncbi.nlm.nih.gov/37440646/","editor":"AIBD"},{"date":"2026-10-29","change":"Linked a comparable incident in the AI Incident Database (incident 764).","source":"https://incidentdatabase.ai/cite/764","editor":"AIBD"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["revisions"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sector":{"state":"value_present","value":{"kind":"record_fields","fields":{"domain":"Professional writing"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["domain"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].access_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"sources[].citation_locator":{"state":"value_present","value":{"kind":"record_fields","fields":{"evidence":[{"kind":"peer-reviewed study","citation":"Noy S, Zhang W. Experimental evidence on the productivity effects of generative artificial intelligence. Science. 2023;381(6654):187-192. doi:10.1126/science.adh2586.","title":"Experimental evidence on the productivity effects of generative artificial intelligence","url":"https://pubmed.ncbi.nlm.nih.gov/37440646/","date":"2023-07-14","written_by":"independent","quote":"Our results show that ChatGPT substantially raised productivity: The average time taken decreased by 40% and output quality rose by 18%."},{"kind":"preprint","citation":"Noy S, Zhang W. Experimental Evidence on the Productivity Effects of Generative Artificial Intelligence. Working paper, MIT, 2 March 2023.","title":"Experimental Evidence on the Productivity Effects of Generative Artificial Intelligence (working paper)","url":"https://economics.mit.edu/sites/default/files/inline-files/Noy_Zhang_1.pdf","date":"2023-03-02","written_by":"independent","quote":"Inequality between workers decreases, as ChatGPT compresses the productivity distribution by benefiting low-ability workers more."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].id":{"state":"value_present","value":{"kind":"identifiers","identifiers":["AIBD-0666-source-0001","AIBD-0666-source-0002"],"role":"Existing evidence items, in their original order"},"provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"complete"},"sources[].language":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"sources[].relationship":{"state":"value_present","value":{"kind":"record_fields","fields":{"evidence":[{"kind":"peer-reviewed study","citation":"Noy S, Zhang W. Experimental evidence on the productivity effects of generative artificial intelligence. Science. 2023;381(6654):187-192. doi:10.1126/science.adh2586.","title":"Experimental evidence on the productivity effects of generative artificial intelligence","url":"https://pubmed.ncbi.nlm.nih.gov/37440646/","date":"2023-07-14","written_by":"independent","quote":"Our results show that ChatGPT substantially raised productivity: The average time taken decreased by 40% and output quality rose by 18%."},{"kind":"preprint","citation":"Noy S, Zhang W. Experimental Evidence on the Productivity Effects of Generative Artificial Intelligence. Working paper, MIT, 2 March 2023.","title":"Experimental Evidence on the Productivity Effects of Generative Artificial Intelligence (working paper)","url":"https://economics.mit.edu/sites/default/files/inline-files/Noy_Zhang_1.pdf","date":"2023-03-02","written_by":"independent","quote":"Inequality between workers decreases, as ChatGPT compresses the productivity distribution by benefiting low-ability workers more."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].upstream_sources":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"strategic_assessments[]":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"strategic assessments"},"summary":{"state":"value_present","value":{"kind":"record_fields","fields":{"summary":"In a preregistered experiment with 453 college-educated professionals, ChatGPT cut time on writing tasks by 40% and raised graded quality by 18%.","account":"Shakked Noy and Whitney Zhang, economists at MIT, gave occupation-specific, incentivized writing tasks to 453 college-educated professionals who worked as marketers, grant writers, consultants, data analysts, human resource professionals and managers. Between the first and second task, a random half were told to sign up for ChatGPT and were allowed to use it on the second task. Science published the study in July 2023. The authors report that average time taken fell by 40% and graded output quality rose by 18%. The working paper, with 444 participants, reports that ChatGPT helped low-ability workers most, which narrowed the gap between workers. Participants exposed to ChatGPT were twice as likely to report using it in their real jobs two weeks later and 1.6 times as likely two months later. The tasks were short and self-contained and were written online for pay, so the result shows what the tool did for this kind of writing; the study does not measure output in the participants' own workplaces. An Emergent Ventures grant, the George and Obie Shultz Fund and the National Science Foundation funded the work."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["summary","account"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"systems[].autonomy_permissions":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].component_role":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].deployment_configuration":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].inputs_outputs":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].model_name":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].model_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].product_name":{"state":"value_present","value":{"kind":"record_fields","fields":{"system":"ChatGPT"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["system"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"systems[].provider":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"taxonomy_crosswalks[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"title":{"state":"value_present","value":{"kind":"record_fields","fields":{"title":"ChatGPT cuts time on professional writing tasks by 40% and raises graded quality by 18% in a preregistered experiment with 453 professionals (Noy and Zhang, Science)","headline":"*ChatGPT* speeds up everyday professional writing"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["title","headline"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"version":{"state":"value_present","value":{"kind":"identifiers","identifiers":["9f76581328b9e4eb21f79f896a4c046dd77b65c03361f5033434d99a02570d01"],"role":"SHA-256 of the complete public case and its assessments"},"provenance":{"kind":"curatorial","basis":"SHA-256 of the public case, its assessments, and its displayed answers and notes, excluding its own identifier and the derived coverage summary.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"complete"},"workflow":{"state":"value_present","value":{"kind":"record_fields","fields":{"account":"Shakked Noy and Whitney Zhang, economists at MIT, gave occupation-specific, incentivized writing tasks to 453 college-educated professionals who worked as marketers, grant writers, consultants, data analysts, human resource professionals and managers. Between the first and second task, a random half were told to sign up for ChatGPT and were allowed to use it on the second task. Science published the study in July 2023. The authors report that average time taken fell by 40% and graded output quality rose by 18%. The working paper, with 444 participants, reports that ChatGPT helped low-ability workers most, which narrowed the gap between workers. Participants exposed to ChatGPT were twice as likely to report using it in their real jobs two weeks later and 1.6 times as likely two months later. The tasks were short and self-contained and were written online for pay, so the result shows what the tool did for this kind of writing; the study does not measure output in the participants' own workplaces. An Emergent Ventures grant, the George and Obie Shultz Fund and the National Science Foundation funded the work.","replication":{"produced_by":["Professionals wrote short, incentivized documents typical of their occupations.","Half received ChatGPT for the second task after writing the first without it."],"must_hold":["The writing task must be short and self-contained.","Writers must review and edit the model's draft."],"echoes":[{"date":"2023-01-01","setting":"University of Minnesota law students drafting legal documents with GPT-4","outcome":"recurred","source":"https://doi.org/10.24926/265535.4225"}]}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["account","replication"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"}},"summary":{"total":91,"addressed":91,"known":44,"reviewed":15,"reviewed_complete":15,"reviewed_partial":0,"record_mapped":29,"review_not_assessed":47,"not_assessed":0,"complete":false,"by_state":{"value_present":44,"not_reported":0,"unresolved":47,"not_assessed":0,"not_applicable":0,"withheld":0,"source_unavailable":0}}},"presentation_version":"4eda20002a2345dd9c5ac0899e7f68c1b2d42ab90e8801fd55c49a78a51407dd"}
