{"id":"AIBD-1011","title":"South Korea's Board of Audit and Inspection finds that the AI job recommendation service scores evenly across occupations but drew fewer applications","summary":"South Korea's audit board found in 2026 that the AI job recommendation service scored about 80% for top and other occupations alike. In 2022 it found lower application rates than with an older system.","date_observed":"2026-01-05","date_basis":"source publication","date_precision":"day","benefit_status":"mixed","source_collection":null,"source_entry":null,"account":"The Korea Employment Information Service runs the AI job recommendation service on Worknet, the public jobs portal. Since July 2020 it has compared jobseekers' résumés with the skills that job postings require and recommended postings to them. It made 1,361,159 recommendations in 2024. In an audit report published on 5 January 2026, South Korea's Board of Audit and Inspection examined job recommenders for bias by occupation. The board reports that the service's hit rate is about 78.0%, an F1 score shown as a percentage. The board analyzed the results itself and found that the hit rate was about 80% both for the 10 most recommended of 1,097 occupations and for the rest. A recommender run by the workers' compensation agency varied far more by occupation. In an audit released in April 2022, the board had compared live use with an older rule-based recommender. Jobseekers applied after 9.45% and 12.99% of their views of AI recommendations in two periods, against 15.22% and 18.36% for the older system. The 2026 hit rate measures matching on evaluation data and does not count hires.","category":"aggregate result","unexpected":false,"purpose":"The Korea Employment Information Service built the AI job recommendation service to match jobseekers' résumés with the skills that job postings require and to recommend suitable postings.","system":"AI 일자리 추천서비스 (AI job recommendation service), called The Work AI on Worknet","model_version":null,"developer":"Korea Employment Information Service (한국고용정보원), for the Ministry of Employment and Labor","deployer":"Korea Employment Information Service, on the Worknet jobs portal of the Ministry of Employment and Labor","location":"South Korea (national)","domain":"Public employment services (job matching)","segment":null,"benefit_type":"Product Personalization","work_activities":["4.A.2.a.1","4.A.4.b.6"],"taxonomy_note":null,"registry_ids":{},"ratings":[{"group":"personal","depth":null,"reason":"The 2026 score comes from evaluation data, and in 2020 and 2021 jobseekers applied less often to the service's recommendations than to the older system's."}],"ai_role":{"status":"assessed","statement":"In its 2022 audit the board compared application rates for the AI system's recommendations with those for an older rule-based recommender in the same periods, and the AI system's rates were lower. The 2026 hit rate measures the model on evaluation data. The 2022 report describes a DeepFM machine-learning model trained on past applications."},"evidence":[{"kind":"audit report","citation":"Board of Audit and Inspection of Korea (감사원). 감사보고서 - 인공지능 대비실태 Ⅰ(신뢰성 확보 분야) - [Performance audit report, AI preparedness I: ensuring reliability]. Report dated December 2025, published 5 January 2026. Chapter 3, section 4, printed p. 54 and footnotes 52 and 53.","title":"감사보고서 - 인공지능 대비실태 Ⅰ(신뢰성 확보 분야) -","url":"https://www.bai.go.kr/api/files/download?fileId=jj20260303%20152833&fileSn=1","date":"2026-01-05","written_by":"independent","quote":"'AI 일자리 추천서비스'의 평가데이터상 추천직종은 총 1,097개이며 추천 상위 10개 직종 및 그 외 직종 그룹의 추천 적중률 모두 약 80% 수준임"},{"kind":"audit report","citation":"Board of Audit and Inspection of Korea (감사원). 감사보고서 - 취업알선정보망 구축 및 관리실태 - [Performance audit report, construction and management of the employment placement information network]. Report dated March 2022, released April 2022. Printed pp. 20-24 and [표 13].","title":"감사보고서 - 취업알선정보망 구축 및 관리실태 -","url":"https://www.bai.go.kr/api/files/download?fileId=jj20220412%20141606&fileSn=1","date":"2022-04-12","written_by":"independent","quote":"새로 개발한 AI 기반 매칭 시스템의 입사지원율 (1차 시행기간 9.45%, 2차 시행기간 12.99%)이 같은 기간 기존의 추천 시스템의 입사지원율 15.22% 및 18.36%에 비해 오히려 각각 5.77%p, 5.37%p 낮은 것으로 확인되었다.","supports_benefit":false}],"replication":{"produced_by":["The service compared each jobseeker's résumé with the skills that job postings require and recommended postings.","A DeepFM machine-learning model trained on past applications scored candidate postings, and the service showed up to 50 of them."],"must_hold":["The evaluation data must span the occupations that the service recommends, and the 2026 data covered 1,097 of them.","Matching scores must track whether jobseekers apply, and in 2022 the board found almost no correlation between them."],"echoes":[]},"paired_incident":null,"headline":"*AI job recommendation service* scores evenly but drew fewer applicants","metric":"scored about 80% for top and other occupations alike","comparator":{"against":"The older rule-based recommender on Worknet (The Work) in the same periods, from July 2020 to October 2021","before":"15.22% and 18.36% of views led to applications","after":"9.45% and 12.99% of views of AI recommendations led to applications","basis":"measured","quote":"새로 개발한 AI 기반 매칭 시스템의 입사지원율 (1차 시행기간 9.45%, 2차 시행기간 12.99%)이 같은 기간 기존의 추천 시스템의 입사지원율 15.22% 및 18.36%에 비해 오히려 각각 5.77%p, 5.37%p 낮은 것으로 확인되었다.","url":"https://www.bai.go.kr/api/files/download?fileId=jj20220412%20141606&fileSn=1"},"later":null,"value":null,"developer_country":"South Korea","deployer_country":"South Korea","unrated_because":"The board's 2026 figure is an evaluation score, and in its 2022 audit the board found lower application rates than with an older recommender, so no gain for jobseekers is established.","brief_notes":null,"brief":null,"revisions":[{"date":"2026-11-01","change":"Added the record from the finding of the Board of Audit and Inspection of Korea.","source":"https://www.bai.go.kr/api/files/download?fileId=jj20260303%20152833&fileSn=1","editor":"AIBD"}],"confidence":"found","shade":"high","claim_status":"Found by an auditor","claim_basis":"Sources: two independent audit reports. For the benefit itself, the cited sources include no independent study or report.","case_jurisdictions":["South Korea"],"profile":{"case_id":"AIBD-1011","catalog_version":"1.0.0","source_fingerprint":"9e1a15e7d075a0bbca6f3bd175809db2e80d1308ecdf78fd819fe7e79241e851","collection_refs":[{"collection_id":"aibd","version":"2026-10-31"},{"collection_id":"querist","version":"2026-10-25"}],"source_ids":["AIBD-1011-source-0001","AIBD-1011-source-0002"],"families":{"strategic assessments":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"evaluations":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"monetary observations":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"institutional decisions":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]}},"fields":{"actors[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"developer":"Korea Employment Information Service (한국고용정보원), for the Ministry of Employment and Labor","deployer":"Korea Employment Information Service, on the Worknet jobs portal of the Ministry of Employment and Labor"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["developer","deployer"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"actors[].ownership_control":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"ai_contribution":{"state":"value_present","value":{"kind":"record_fields","fields":{"ai_role":{"status":"assessed","statement":"In its 2022 audit the board compared application rates for the AI system's recommendations with those for an older rule-based recommender in the same periods, and the AI system's rates were lower. The 2026 hit rate measures the model on evaluation data. The 2022 report describes a DeepFM machine-learning model trained on past applications."}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ai_role"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"ai_relationship":{"state":"value_present","value":{"kind":"record_fields","fields":{"category":"aggregate result","ai_role":{"status":"assessed","statement":"In its 2022 audit the board compared application rates for the AI system's recommendations with those for an older rule-based recommender in the same periods, and the AI system's rates were lower. The 2026 hit rate measures the model on evaluation data. The 2022 report describes a DeepFM machine-learning model trained on past applications."}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ai_role","category"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].alternatives":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].assessor_date":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].depth":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].display_confidence":{"state":"value_present","value":{"kind":"structured","data":{"confidence":"high","evidence_word":"found","claim_status":"Found by an auditor","basis":"Sources: two independent audit reports. For the benefit itself, the cited sources include no independent study or report.","interpretation":"Existing display rule preserved; the richer outcome-specific confidence question still needs review."}},"provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].rationale":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"personal","reason":"The 2026 score comes from evaluation data, and in 2020 and 2021 jobseekers applied less often to the service's recommendations than to the older system's."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].rubric_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].status_basis":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].target":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"personal","reason":"The 2026 score comes from evaluation data, and in 2020 and 2021 jobseekers applied less often to the service's recommendations than to the older system's."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"availability":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"brief":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"case_kind":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"case_links[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].evidence_links":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].evidence_strength":{"state":"value_present","value":{"kind":"structured","data":{"answer":"Found by an auditor. Sources: two independent audit reports. For the benefit itself, the cited sources include no independent study or report.","evidence_word":"found","claim_status":"Found by an auditor"}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-1011-source-0001","AIBD-1011-source-0002"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Found by an auditor. Sources: two independent audit reports. For the benefit itself, the cited sources include no independent study or report.","inferred":false}},"claims[].missingness":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].proposition":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"cross_border_flows[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"decisions[].action_outcome":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].grounds":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].institution_task":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].success_criterion":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"deployment_stage":{"state":"value_present","value":{"kind":"structured","data":{"classification":"routine use","answer":"The system was in routine use. The service made 1,361,159 recommendations on Worknet in 2024.","scope":"The period and activity described in the case."}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["account","evidence"],"source_refs":["AIBD-1011-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"The system was in routine use. The service made 1,361,159 recommendations on Worknet in 2024.","inferred":false}},"economics[].amount":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].costs[]":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].counterfactual":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].currency_price_basis":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].gross_net":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].measure_type":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].period_unit":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].realization":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].recipient_payer":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].return_payback":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].valuation_method":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"evaluations[].ai_uplift":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].comparator":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].design":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].effect":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].exposure":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].id":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].measurement_method":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].metric":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].reproduction_materials":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].setting_sample":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].uncertainty_limitations":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"external_references[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"follow_up[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"human_oversight":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"id":{"state":"value_present","value":{"kind":"record_fields","fields":{"id":"AIBD-1011"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["id"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"infrastructure_dependencies[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].beneficiaries":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].beneficiary_count":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].benefit_type":{"state":"value_present","value":{"kind":"record_fields","fields":{"benefit_type":"Product Personalization"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["benefit_type"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].claim":{"state":"value_present","value":{"kind":"record_fields","fields":{"account":"The Korea Employment Information Service runs the AI job recommendation service on Worknet, the public jobs portal. Since July 2020 it has compared jobseekers' résumés with the skills that job postings require and recommended postings to them. It made 1,361,159 recommendations in 2024. In an audit report published on 5 January 2026, South Korea's Board of Audit and Inspection examined job recommenders for bias by occupation. The board reports that the service's hit rate is about 78.0%, an F1 score shown as a percentage. The board analyzed the results itself and found that the hit rate was about 80% both for the 10 most recommended of 1,097 occupations and for the rest. A recommender run by the workers' compensation agency varied far more by occupation. In an audit released in April 2022, the board had compared live use with an older rule-based recommender. Jobseekers applied after 9.45% and 12.99% of their views of AI recommendations in two periods, against 15.22% and 18.36% for the older system. The 2026 hit rate measures matching on evaluation data and does not count hires.","benefit_type":"Product Personalization"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["account","benefit_type"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].distribution":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].duration":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].id":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].stakeholder_group":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"personal","reason":"The 2026 score comes from evaluation data, and in 2020 and 2021 jobseekers applied less often to the service's recommendations than to the older system's."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].status":{"state":"value_present","value":{"kind":"record_fields","fields":{"benefit_status":"mixed"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["benefit_status"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].tradeoffs":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].unexpected":{"state":"value_present","value":{"kind":"record_fields","fields":{"unexpected":false,"purpose":"The Korea Employment Information Service built the AI job recommendation service to match jobseekers' résumés with the skills that job postings require and to recommend suitable postings."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["unexpected","purpose"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"places[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"location":"South Korea (national)","developer_country":"South Korea","deployer_country":"South Korea"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["location","developer_country","deployer_country"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"purpose":{"state":"value_present","value":{"kind":"record_fields","fields":{"purpose":"The Korea Employment Information Service built the AI job recommendation service to match jobseekers' résumés with the skills that job postings require and to recommend suitable postings."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["purpose"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"record_dates":{"state":"value_present","value":{"kind":"record_fields","fields":{"date_observed":"2026-01-05","date_basis":"source publication","date_precision":"day","revisions":[{"date":"2026-11-01","change":"Added the record from the finding of the Board of Audit and Inspection of Korea.","source":"https://www.bai.go.kr/api/files/download?fileId=jj20260303%20152833&fileSn=1","editor":"AIBD"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["date_observed","date_basis","date_precision","revisions"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"replication.attempts[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"replication.conditions":{"state":"value_present","value":{"kind":"record_fields","fields":{"replication":{"produced_by":["The service compared each jobseeker's résumé with the skills that job postings require and recommended postings.","A DeepFM machine-learning model trained on past applications scored candidate postings, and the service showed up to 50 of them."],"must_hold":["The evaluation data must span the occupations that the service recommends, and the 2026 data covered 1,097 of them.","Matching scores must track whether jobseekers apply, and in 2022 the board found almost no correlation between them."],"echoes":[]}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["replication"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"revision_history[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"revisions":[{"date":"2026-11-01","change":"Added the record from the finding of the Board of Audit and Inspection of Korea.","source":"https://www.bai.go.kr/api/files/download?fileId=jj20260303%20152833&fileSn=1","editor":"AIBD"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["revisions"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sector":{"state":"value_present","value":{"kind":"record_fields","fields":{"domain":"Public employment services (job matching)"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["domain"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].access_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"sources[].citation_locator":{"state":"value_present","value":{"kind":"record_fields","fields":{"evidence":[{"kind":"audit report","citation":"Board of Audit and Inspection of Korea (감사원). 감사보고서 - 인공지능 대비실태 Ⅰ(신뢰성 확보 분야) - [Performance audit report, AI preparedness I: ensuring reliability]. Report dated December 2025, published 5 January 2026. Chapter 3, section 4, printed p. 54 and footnotes 52 and 53.","title":"감사보고서 - 인공지능 대비실태 Ⅰ(신뢰성 확보 분야) -","url":"https://www.bai.go.kr/api/files/download?fileId=jj20260303%20152833&fileSn=1","date":"2026-01-05","written_by":"independent","quote":"'AI 일자리 추천서비스'의 평가데이터상 추천직종은 총 1,097개이며 추천 상위 10개 직종 및 그 외 직종 그룹의 추천 적중률 모두 약 80% 수준임"},{"kind":"audit report","citation":"Board of Audit and Inspection of Korea (감사원). 감사보고서 - 취업알선정보망 구축 및 관리실태 - [Performance audit report, construction and management of the employment placement information network]. Report dated March 2022, released April 2022. Printed pp. 20-24 and [표 13].","title":"감사보고서 - 취업알선정보망 구축 및 관리실태 -","url":"https://www.bai.go.kr/api/files/download?fileId=jj20220412%20141606&fileSn=1","date":"2022-04-12","written_by":"independent","quote":"새로 개발한 AI 기반 매칭 시스템의 입사지원율 (1차 시행기간 9.45%, 2차 시행기간 12.99%)이 같은 기간 기존의 추천 시스템의 입사지원율 15.22% 및 18.36%에 비해 오히려 각각 5.77%p, 5.37%p 낮은 것으로 확인되었다.","supports_benefit":false}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].id":{"state":"value_present","value":{"kind":"identifiers","identifiers":["AIBD-1011-source-0001","AIBD-1011-source-0002"],"role":"Existing evidence items, in their original order"},"provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"complete"},"sources[].language":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"sources[].relationship":{"state":"value_present","value":{"kind":"record_fields","fields":{"evidence":[{"kind":"audit report","citation":"Board of Audit and Inspection of Korea (감사원). 감사보고서 - 인공지능 대비실태 Ⅰ(신뢰성 확보 분야) - [Performance audit report, AI preparedness I: ensuring reliability]. Report dated December 2025, published 5 January 2026. Chapter 3, section 4, printed p. 54 and footnotes 52 and 53.","title":"감사보고서 - 인공지능 대비실태 Ⅰ(신뢰성 확보 분야) -","url":"https://www.bai.go.kr/api/files/download?fileId=jj20260303%20152833&fileSn=1","date":"2026-01-05","written_by":"independent","quote":"'AI 일자리 추천서비스'의 평가데이터상 추천직종은 총 1,097개이며 추천 상위 10개 직종 및 그 외 직종 그룹의 추천 적중률 모두 약 80% 수준임"},{"kind":"audit report","citation":"Board of Audit and Inspection of Korea (감사원). 감사보고서 - 취업알선정보망 구축 및 관리실태 - [Performance audit report, construction and management of the employment placement information network]. Report dated March 2022, released April 2022. Printed pp. 20-24 and [표 13].","title":"감사보고서 - 취업알선정보망 구축 및 관리실태 -","url":"https://www.bai.go.kr/api/files/download?fileId=jj20220412%20141606&fileSn=1","date":"2022-04-12","written_by":"independent","quote":"새로 개발한 AI 기반 매칭 시스템의 입사지원율 (1차 시행기간 9.45%, 2차 시행기간 12.99%)이 같은 기간 기존의 추천 시스템의 입사지원율 15.22% 및 18.36%에 비해 오히려 각각 5.77%p, 5.37%p 낮은 것으로 확인되었다.","supports_benefit":false}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].upstream_sources":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"strategic_assessments[]":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"strategic assessments"},"summary":{"state":"value_present","value":{"kind":"record_fields","fields":{"summary":"South Korea's audit board found in 2026 that the AI job recommendation service scored about 80% for top and other occupations alike. In 2022 it found lower application rates than with an older system.","account":"The Korea Employment Information Service runs the AI job recommendation service on Worknet, the public jobs portal. Since July 2020 it has compared jobseekers' résumés with the skills that job postings require and recommended postings to them. It made 1,361,159 recommendations in 2024. In an audit report published on 5 January 2026, South Korea's Board of Audit and Inspection examined job recommenders for bias by occupation. The board reports that the service's hit rate is about 78.0%, an F1 score shown as a percentage. The board analyzed the results itself and found that the hit rate was about 80% both for the 10 most recommended of 1,097 occupations and for the rest. A recommender run by the workers' compensation agency varied far more by occupation. In an audit released in April 2022, the board had compared live use with an older rule-based recommender. Jobseekers applied after 9.45% and 12.99% of their views of AI recommendations in two periods, against 15.22% and 18.36% for the older system. The 2026 hit rate measures matching on evaluation data and does not count hires."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["summary","account"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"systems[].autonomy_permissions":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].component_role":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].deployment_configuration":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].inputs_outputs":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].model_name":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].model_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].product_name":{"state":"value_present","value":{"kind":"record_fields","fields":{"system":"AI 일자리 추천서비스 (AI job recommendation service), called The Work AI on Worknet"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["system"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"systems[].provider":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"taxonomy_crosswalks[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"title":{"state":"value_present","value":{"kind":"record_fields","fields":{"title":"South Korea's Board of Audit and Inspection finds that the AI job recommendation service scores evenly across occupations but drew fewer applications","headline":"*AI job recommendation service* scores evenly but drew fewer applicants"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["title","headline"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"version":{"state":"value_present","value":{"kind":"identifiers","identifiers":["084147c7cc39595b037887c993adfddae6f6eecee3232a0d6ce4b8daaf6b7f19"],"role":"SHA-256 of the complete public record and its assessments"},"provenance":{"kind":"curatorial","basis":"SHA-256 of the public record, its assessments, and its displayed answers and notes, excluding its own identifier and the derived coverage summary.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"complete"},"workflow":{"state":"value_present","value":{"kind":"record_fields","fields":{"account":"The Korea Employment Information Service runs the AI job recommendation service on Worknet, the public jobs portal. Since July 2020 it has compared jobseekers' résumés with the skills that job postings require and recommended postings to them. It made 1,361,159 recommendations in 2024. In an audit report published on 5 January 2026, South Korea's Board of Audit and Inspection examined job recommenders for bias by occupation. The board reports that the service's hit rate is about 78.0%, an F1 score shown as a percentage. The board analyzed the results itself and found that the hit rate was about 80% both for the 10 most recommended of 1,097 occupations and for the rest. A recommender run by the workers' compensation agency varied far more by occupation. In an audit released in April 2022, the board had compared live use with an older rule-based recommender. Jobseekers applied after 9.45% and 12.99% of their views of AI recommendations in two periods, against 15.22% and 18.36% for the older system. The 2026 hit rate measures matching on evaluation data and does not count hires.","replication":{"produced_by":["The service compared each jobseeker's résumé with the skills that job postings require and recommended postings.","A DeepFM machine-learning model trained on past applications scored candidate postings, and the service showed up to 50 of them."],"must_hold":["The evaluation data must span the occupations that the service recommends, and the 2026 data covered 1,097 of them.","Matching scores must track whether jobseekers apply, and in 2022 the board found almost no correlation between them."],"echoes":[]}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["account","replication"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"}},"summary":{"total":91,"addressed":91,"known":28,"reviewed":2,"reviewed_complete":2,"reviewed_partial":0,"record_mapped":26,"review_not_assessed":63,"not_assessed":0,"complete":false,"by_state":{"value_present":28,"not_reported":0,"unresolved":63,"not_assessed":0,"not_applicable":0,"withheld":0,"source_unavailable":0}}},"presentation_version":"8b2136478925d687a1fc5af04a501f2db39d1bd9ea6c37992d7ea42dbca7c368"}