{"id":"AIBD-1152","title":"Economists who designed La Bonne Boîte recommendations for Pôle emploi find a 1% rise in short-term job finding and no clear rise in all hiring","summary":"In a 2019 French trial, emails recommending firms that La Bonne Boîte predicted would hire raised job finding in short-term contracts by 1%, with no statistically significant effect on all hiring.","date_observed":"2019-11-01","date_basis":"event","date_precision":"month","benefit_status":"mixed","source_collection":null,"source_entry":null,"account":"Pôle emploi, now France Travail, has run La Bonne Boîte since 2015. The platform predicts which firms are likely to hire in each occupation, and France's Cour des comptes says that its predictions rest on machine learning. Five economists, two of them at the Paris School of Economics, designed a model that chose which firms to recommend to each job seeker. Between 19 November and 4 December 2019, about 500,000 registered job seekers received emails linking to recommended firms. About 300,000 others formed the control group. In an IZA discussion paper of February 2024, the authors report that the emails raised job finding in short-term contracts by 1%, with a p-value of 0.09. They found no statistically significant effect on job finding across all contracts. Applications to recommended firms were 2.7 times as efficient as applications to the average firm. The authors designed the recommendations that they evaluated. They followed hiring for four months, until the Covid-19 lockdown.","category":"aggregate result","unexpected":false,"purpose":"Pôle emploi built La Bonne Boîte to direct job seekers' unsolicited applications to firms that it predicts will hire. The study's authors added a model that chose which firms to recommend to each job seeker.","system":"La Bonne Boîte (LBB) hiring predictions, with firm recommendations sent by email","model_version":null,"developer":"Pôle emploi, now France Travail (La Bonne Boîte), with the study's authors (recommendation design)","deployer":"Pôle emploi, now France Travail, with the study's authors, in an emailing experiment with about 800,000 registered job seekers","location":"France (national)","domain":"Public employment services (job matching)","segment":null,"benefit_type":"Product Personalization","work_activities":["4.A.1.b.3","4.A.4.b.6"],"taxonomy_note":"The recommendations were tailored to each job seeker. The benefit measured is hiring.","registry_ids":{},"ratings":[{"group":"personal","depth":null,"reason":"Job finding across all contracts showed no statistically significant change, and the 1% rise in short-term hiring had a p-value of 0.09."}],"ai_role":{"status":"unassessed","statement":"Job seekers were randomly assigned to receive the emails or not. The emails combined La Bonne Boîte's hiring predictions, the authors' choice of firms and encouragement to use the platform, so the predictions' own share is not isolated. The authors found that applications to firms with above-median predicted hiring succeeded 3.4 times as often as applications to firms below the median."},"evidence":[{"kind":"report","citation":"Behaghel L, Dromundo S, Gurgand M, Hazard Y, Zuber T. The Potential of Recommender Systems for Directing Job Search: A Large-Scale Experiment. IZA Discussion Paper No. 16781, February 2024. Abstract, p. 1. The authors designed the recommendations with the support of Pôle emploi and La Bonne Boîte, with funding from ANR grant ANR-17-EURE-0001.","title":"The Potential of Recommender Systems for Directing Job Search: A Large-Scale Experiment","url":"https://docs.iza.org/dp16781.pdf","date":"2024-02-01","written_by":"makers","quote":"Our intervention induces a 1% increase in job finding rates for short term contracts."},{"kind":"audit report","citation":"Cour des comptes. France Travail et l'intelligence artificielle. Observations définitives S2025-1558, adopted 15 October 2025 and published 8 January 2026, section 1.1.2, p. 20. Describes La Bonne Boîte's predictions without assessing the experiment.","title":"France Travail et l'intelligence artificielle","url":"https://www.ccomptes.fr/sites/default/files/2026-01/20260108-S2025-1558-France-Travail-et-intelligence-artificielle_0.pdf","date":"2026-01-08","written_by":"independent","quote":"permet d'identifier les entreprises à fort potentiel d'embauche, selon une analyse prédictive reposant sur un module d'apprentissage automatique (machine learning)","supports_benefit":false}],"replication":{"produced_by":["La Bonne Boîte predicted hiring for each firm and occupation from administrative data on all French firms.","The authors' model chose recommendations to maximize total expected employment, allowing for congestion at each firm.","Job seekers received two or four emails, each with links to at most two recommended firms."],"must_hold":["Job seekers must apply to the recommended firms, and the authors estimate that the emails raised application rates by only one percentage point.","Recommendations must favor firms with high predicted hiring, since applications to them succeeded far more often."],"echoes":[]},"paired_incident":null,"headline":"*La Bonne Boîte* tips lift short-term hiring a little in France","metric":"raised job finding in short-term contracts by 1%","comparator":{"against":"About 300,000 registered job seekers in the control group, who received no emails","before":"Baseline job finding rate in short-term contracts of 0.15 over four months","after":"0.14 percentage point higher (p = 0.09)","basis":"measured","quote":"However, there is a marginally significant (p-value = 0.09) impact of our intervention on job finding rates in short-term contracts, the most frequent outcome at baseline (column (3)).","url":"https://docs.iza.org/dp16781.pdf"},"later":null,"value":null,"developer_country":"France","deployer_country":"France","unrated_because":"The effect on job finding across all contracts was not statistically significant, and the rise in short-term hiring had a p-value of 0.09.","brief_notes":null,"brief":null,"revisions":[{"date":"2026-11-01","change":"Added the record from the report of Behaghel, Dromundo, Gurgand, Hazard and Zuber.","source":"https://docs.iza.org/dp16781.pdf","editor":"AIBD"}],"confidence":"claimed","shade":"low","claim_status":"The makers' claim","claim_basis":"Sources: one independent audit report and the makers' report. For the benefit itself, the cited sources include no independent source and no finding by an external body.","case_jurisdictions":["France"],"profile":{"case_id":"AIBD-1152","catalog_version":"1.0.0","source_fingerprint":"9a8c46b2c6ca2b6fce64c8ec4b8c5855abe3dc6239e47831657b942fd0d890ac","collection_refs":[{"collection_id":"aibd","version":"2026-10-31"},{"collection_id":"querist","version":"2026-10-25"}],"source_ids":["AIBD-1152-source-0001","AIBD-1152-source-0002"],"families":{"strategic assessments":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"evaluations":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"monetary observations":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"institutional decisions":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]}},"fields":{"actors[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"developer":"Pôle emploi, now France Travail (La Bonne Boîte), with the study's authors (recommendation design)","deployer":"Pôle emploi, now France Travail, with the study's authors, in an emailing experiment with about 800,000 registered job seekers"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["developer","deployer"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"actors[].ownership_control":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"ai_contribution":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"ai_relationship":{"state":"value_present","value":{"kind":"record_fields","fields":{"category":"aggregate result","ai_role":{"status":"unassessed","statement":"Job seekers were randomly assigned to receive the emails or not. The emails combined La Bonne Boîte's hiring predictions, the authors' choice of firms and encouragement to use the platform, so the predictions' own share is not isolated. The authors found that applications to firms with above-median predicted hiring succeeded 3.4 times as often as applications to firms below the median."}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ai_role","category"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].alternatives":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].assessor_date":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].depth":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].display_confidence":{"state":"value_present","value":{"kind":"structured","data":{"confidence":"low","evidence_word":"claimed","claim_status":"The makers' claim","basis":"Sources: one independent audit report and the makers' report. For the benefit itself, the cited sources include no independent source and no finding by an external body.","interpretation":"Existing display rule preserved; the richer outcome-specific confidence question still needs review."}},"provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].rationale":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"personal","reason":"Job finding across all contracts showed no statistically significant change, and the 1% rise in short-term hiring had a p-value of 0.09."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].rubric_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].status_basis":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].target":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"personal","reason":"Job finding across all contracts showed no statistically significant change, and the 1% rise in short-term hiring had a p-value of 0.09."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"availability":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"brief":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"case_kind":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"case_links[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].evidence_links":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].evidence_strength":{"state":"value_present","value":{"kind":"structured","data":{"answer":"The makers' claim. Sources: one independent audit report and the makers' report. For the benefit itself, the cited sources include no independent source and no finding by an external body.","evidence_word":"claimed","claim_status":"The makers' claim"}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-1152-source-0001","AIBD-1152-source-0002"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"The makers' claim. Sources: one independent audit report and the makers' report. For the benefit itself, the cited sources include no independent source and no finding by an external body.","inferred":false}},"claims[].missingness":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].proposition":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"cross_border_flows[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"decisions[].action_outcome":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].grounds":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].institution_task":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].success_criterion":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"deployment_stage":{"state":"value_present","value":{"kind":"structured","data":{"classification":"pilot","answer":"The system was used in a pilot. The tailored recommendations went out once, in a two-week emailing experiment in late 2019.","scope":"The period and activity described in the case."}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["account","evidence"],"source_refs":["AIBD-1152-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"The system was used in a pilot. The tailored recommendations went out once, in a two-week emailing experiment in late 2019.","inferred":false}},"economics[].amount":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].costs[]":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].counterfactual":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].currency_price_basis":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].gross_net":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].measure_type":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].period_unit":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].realization":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].recipient_payer":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].return_payback":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].valuation_method":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"evaluations[].ai_uplift":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].comparator":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].design":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].effect":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].exposure":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].id":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].measurement_method":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].metric":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].reproduction_materials":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].setting_sample":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].uncertainty_limitations":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"external_references[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"follow_up[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"human_oversight":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"id":{"state":"value_present","value":{"kind":"record_fields","fields":{"id":"AIBD-1152"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["id"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"infrastructure_dependencies[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].beneficiaries":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].beneficiary_count":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].benefit_type":{"state":"value_present","value":{"kind":"record_fields","fields":{"benefit_type":"Product Personalization","taxonomy_note":"The recommendations were tailored to each job seeker. The benefit measured is hiring."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["benefit_type","taxonomy_note"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].claim":{"state":"value_present","value":{"kind":"record_fields","fields":{"account":"Pôle emploi, now France Travail, has run La Bonne Boîte since 2015. The platform predicts which firms are likely to hire in each occupation, and France's Cour des comptes says that its predictions rest on machine learning. Five economists, two of them at the Paris School of Economics, designed a model that chose which firms to recommend to each job seeker. Between 19 November and 4 December 2019, about 500,000 registered job seekers received emails linking to recommended firms. About 300,000 others formed the control group. In an IZA discussion paper of February 2024, the authors report that the emails raised job finding in short-term contracts by 1%, with a p-value of 0.09. They found no statistically significant effect on job finding across all contracts. Applications to recommended firms were 2.7 times as efficient as applications to the average firm. The authors designed the recommendations that they evaluated. They followed hiring for four months, until the Covid-19 lockdown.","benefit_type":"Product Personalization"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["account","benefit_type"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].distribution":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].duration":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].id":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].stakeholder_group":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"personal","reason":"Job finding across all contracts showed no statistically significant change, and the 1% rise in short-term hiring had a p-value of 0.09."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].status":{"state":"value_present","value":{"kind":"record_fields","fields":{"benefit_status":"mixed"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["benefit_status"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].tradeoffs":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].unexpected":{"state":"value_present","value":{"kind":"record_fields","fields":{"unexpected":false,"purpose":"Pôle emploi built La Bonne Boîte to direct job seekers' unsolicited applications to firms that it predicts will hire. The study's authors added a model that chose which firms to recommend to each job seeker."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["unexpected","purpose"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"places[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"location":"France (national)","developer_country":"France","deployer_country":"France"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["location","developer_country","deployer_country"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"purpose":{"state":"value_present","value":{"kind":"record_fields","fields":{"purpose":"Pôle emploi built La Bonne Boîte to direct job seekers' unsolicited applications to firms that it predicts will hire. The study's authors added a model that chose which firms to recommend to each job seeker."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["purpose"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"record_dates":{"state":"value_present","value":{"kind":"record_fields","fields":{"date_observed":"2019-11-01","date_basis":"event","date_precision":"month","revisions":[{"date":"2026-11-01","change":"Added the record from the report of Behaghel, Dromundo, Gurgand, Hazard and Zuber.","source":"https://docs.iza.org/dp16781.pdf","editor":"AIBD"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["date_observed","date_basis","date_precision","revisions"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"replication.attempts[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"replication.conditions":{"state":"value_present","value":{"kind":"record_fields","fields":{"replication":{"produced_by":["La Bonne Boîte predicted hiring for each firm and occupation from administrative data on all French firms.","The authors' model chose recommendations to maximize total expected employment, allowing for congestion at each firm.","Job seekers received two or four emails, each with links to at most two recommended firms."],"must_hold":["Job seekers must apply to the recommended firms, and the authors estimate that the emails raised application rates by only one percentage point.","Recommendations must favor firms with high predicted hiring, since applications to them succeeded far more often."],"echoes":[]}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["replication"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"revision_history[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"revisions":[{"date":"2026-11-01","change":"Added the record from the report of Behaghel, Dromundo, Gurgand, Hazard and Zuber.","source":"https://docs.iza.org/dp16781.pdf","editor":"AIBD"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["revisions"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sector":{"state":"value_present","value":{"kind":"record_fields","fields":{"domain":"Public employment services (job matching)"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["domain"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].access_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"sources[].citation_locator":{"state":"value_present","value":{"kind":"record_fields","fields":{"evidence":[{"kind":"report","citation":"Behaghel L, Dromundo S, Gurgand M, Hazard Y, Zuber T. The Potential of Recommender Systems for Directing Job Search: A Large-Scale Experiment. IZA Discussion Paper No. 16781, February 2024. Abstract, p. 1. The authors designed the recommendations with the support of Pôle emploi and La Bonne Boîte, with funding from ANR grant ANR-17-EURE-0001.","title":"The Potential of Recommender Systems for Directing Job Search: A Large-Scale Experiment","url":"https://docs.iza.org/dp16781.pdf","date":"2024-02-01","written_by":"makers","quote":"Our intervention induces a 1% increase in job finding rates for short term contracts."},{"kind":"audit report","citation":"Cour des comptes. France Travail et l'intelligence artificielle. Observations définitives S2025-1558, adopted 15 October 2025 and published 8 January 2026, section 1.1.2, p. 20. Describes La Bonne Boîte's predictions without assessing the experiment.","title":"France Travail et l'intelligence artificielle","url":"https://www.ccomptes.fr/sites/default/files/2026-01/20260108-S2025-1558-France-Travail-et-intelligence-artificielle_0.pdf","date":"2026-01-08","written_by":"independent","quote":"permet d'identifier les entreprises à fort potentiel d'embauche, selon une analyse prédictive reposant sur un module d'apprentissage automatique (machine learning)","supports_benefit":false}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].id":{"state":"value_present","value":{"kind":"identifiers","identifiers":["AIBD-1152-source-0001","AIBD-1152-source-0002"],"role":"Existing evidence items, in their original order"},"provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"complete"},"sources[].language":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"sources[].relationship":{"state":"value_present","value":{"kind":"record_fields","fields":{"evidence":[{"kind":"report","citation":"Behaghel L, Dromundo S, Gurgand M, Hazard Y, Zuber T. The Potential of Recommender Systems for Directing Job Search: A Large-Scale Experiment. IZA Discussion Paper No. 16781, February 2024. Abstract, p. 1. The authors designed the recommendations with the support of Pôle emploi and La Bonne Boîte, with funding from ANR grant ANR-17-EURE-0001.","title":"The Potential of Recommender Systems for Directing Job Search: A Large-Scale Experiment","url":"https://docs.iza.org/dp16781.pdf","date":"2024-02-01","written_by":"makers","quote":"Our intervention induces a 1% increase in job finding rates for short term contracts."},{"kind":"audit report","citation":"Cour des comptes. France Travail et l'intelligence artificielle. Observations définitives S2025-1558, adopted 15 October 2025 and published 8 January 2026, section 1.1.2, p. 20. Describes La Bonne Boîte's predictions without assessing the experiment.","title":"France Travail et l'intelligence artificielle","url":"https://www.ccomptes.fr/sites/default/files/2026-01/20260108-S2025-1558-France-Travail-et-intelligence-artificielle_0.pdf","date":"2026-01-08","written_by":"independent","quote":"permet d'identifier les entreprises à fort potentiel d'embauche, selon une analyse prédictive reposant sur un module d'apprentissage automatique (machine learning)","supports_benefit":false}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].upstream_sources":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"strategic_assessments[]":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"strategic assessments"},"summary":{"state":"value_present","value":{"kind":"record_fields","fields":{"summary":"In a 2019 French trial, emails recommending firms that La Bonne Boîte predicted would hire raised job finding in short-term contracts by 1%, with no statistically significant effect on all hiring.","account":"Pôle emploi, now France Travail, has run La Bonne Boîte since 2015. The platform predicts which firms are likely to hire in each occupation, and France's Cour des comptes says that its predictions rest on machine learning. Five economists, two of them at the Paris School of Economics, designed a model that chose which firms to recommend to each job seeker. Between 19 November and 4 December 2019, about 500,000 registered job seekers received emails linking to recommended firms. About 300,000 others formed the control group. In an IZA discussion paper of February 2024, the authors report that the emails raised job finding in short-term contracts by 1%, with a p-value of 0.09. They found no statistically significant effect on job finding across all contracts. Applications to recommended firms were 2.7 times as efficient as applications to the average firm. The authors designed the recommendations that they evaluated. They followed hiring for four months, until the Covid-19 lockdown."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["summary","account"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"systems[].autonomy_permissions":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].component_role":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].deployment_configuration":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].inputs_outputs":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].model_name":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].model_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].product_name":{"state":"value_present","value":{"kind":"record_fields","fields":{"system":"La Bonne Boîte (LBB) hiring predictions, with firm recommendations sent by email"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["system"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"systems[].provider":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"taxonomy_crosswalks[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"title":{"state":"value_present","value":{"kind":"record_fields","fields":{"title":"Economists who designed La Bonne Boîte recommendations for Pôle emploi find a 1% rise in short-term job finding and no clear rise in all hiring","headline":"*La Bonne Boîte* tips lift short-term hiring a little in France"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["title","headline"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"version":{"state":"value_present","value":{"kind":"identifiers","identifiers":["fb3fd4fd6221ad5cee706e30f6c5741c5d03b1bb017e598d36b78dd824afcbc2"],"role":"SHA-256 of the complete public record and its assessments"},"provenance":{"kind":"curatorial","basis":"SHA-256 of the public record, its assessments, and its displayed answers and notes, excluding its own identifier and the derived coverage summary.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"complete"},"workflow":{"state":"value_present","value":{"kind":"record_fields","fields":{"account":"Pôle emploi, now France Travail, has run La Bonne Boîte since 2015. The platform predicts which firms are likely to hire in each occupation, and France's Cour des comptes says that its predictions rest on machine learning. Five economists, two of them at the Paris School of Economics, designed a model that chose which firms to recommend to each job seeker. Between 19 November and 4 December 2019, about 500,000 registered job seekers received emails linking to recommended firms. About 300,000 others formed the control group. In an IZA discussion paper of February 2024, the authors report that the emails raised job finding in short-term contracts by 1%, with a p-value of 0.09. They found no statistically significant effect on job finding across all contracts. Applications to recommended firms were 2.7 times as efficient as applications to the average firm. The authors designed the recommendations that they evaluated. They followed hiring for four months, until the Covid-19 lockdown.","replication":{"produced_by":["La Bonne Boîte predicted hiring for each firm and occupation from administrative data on all French firms.","The authors' model chose recommendations to maximize total expected employment, allowing for congestion at each firm.","Job seekers received two or four emails, each with links to at most two recommended firms."],"must_hold":["Job seekers must apply to the recommended firms, and the authors estimate that the emails raised application rates by only one percentage point.","Recommendations must favor firms with high predicted hiring, since applications to them succeeded far more often."],"echoes":[]}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["account","replication"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"}},"summary":{"total":91,"addressed":91,"known":27,"reviewed":2,"reviewed_complete":2,"reviewed_partial":0,"record_mapped":25,"review_not_assessed":64,"not_assessed":0,"complete":false,"by_state":{"value_present":27,"not_reported":0,"unresolved":64,"not_assessed":0,"not_applicable":0,"withheld":0,"source_unavailable":0}}},"presentation_version":"4658fab1c4836788f7b96ddf4307196fa8417e85919a3ca5afc8da32c1a69f9b"}