{"id":"AIBD-0698","title":"UNDP's evaluation office finds that the AI system of Brazil's National Council of Justice let courts fast-track high-risk cases from vulnerable groups","summary":"UNDP's evaluation office found that the AI system of Brazil's National Council of Justice let courts prioritize urgent cases and high-risk cases from vulnerable groups.","date_observed":"2023-11-01","date_basis":"source publication","date_precision":"month","benefit_status":"reported","source_collection":null,"source_entry":null,"account":"In November 2023, UNDP's Independent Evaluation Office published an evaluation of UNDP support for the digitalization of public services. The team drew on 15 case studies and in-depth studies of countries, desk reviews of 25 countries and interviews. In its section on justice, the office writes that UNDP tested a best practice in the artificial intelligence system of Brazil's National Council of Justice (CNJ). The work aimed to address court backlogs and to identify trends in judicial processes that disproportionately affect vulnerable communities. The office found that the use of AI enabled courts to focus on urgent cases and manage cases more efficiently. It also let them fast-track high-risk cases brought by vulnerable groups, particularly women. The office describes AI in the management of court cases as analysis of data patterns from past cases that predicts or recommends outcomes. The office gives no figures and cites no source for the Brazilian result. It calls AI a nascent area of UNDP work and writes that more attention is needed on how to integrate AI into court management.","category":"program","unexpected":false,"purpose":"The National Council of Justice uses its artificial intelligence system for managing court cases. UNDP's work on it aimed to address backlogs and identify trends in cases that disproportionately affect vulnerable communities.","system":"Artificial Intelligence System of Brazil's National Council of Justice (CNJ)","model_version":null,"developer":"Not named in the evaluation (the system belongs to the National Council of Justice, CNJ)","deployer":"Brazilian courts under the National Council of Justice (CNJ), with UNDP","location":"Brazil","domain":"Justice administration: managing court cases","segment":null,"benefit_type":"Improved Organizational Efficiency","work_activities":["4.A.2.b.6","4.A.2.a.4"],"taxonomy_note":null,"registry_ids":{},"ratings":[{"group":"organizational","depth":null,"reason":"The office states the effects on case handling without figures or a cited source."},{"group":"personal","depth":null,"reason":"No count of fast-tracked cases from vulnerable groups, including women, is given."}],"ai_role":{"status":"unassessed","statement":"The office describes AI and machine learning in the management of court cases in general terms and names no model or tool for the council's system. It gives no comparison of courts with and without the system, so the AI's part is not separated."},"evidence":[{"kind":"evaluation report","citation":"UNDP Independent Evaluation Office. Evaluation of the UNDP Support to Digitalization of Public Services. November 2023. The report is an independent publication of the office. Section on justice and the rule of law.","title":"Evaluation of the UNDP Support to Digitalization of Public Services","url":"https://www.unevaluation.org/get-download-file/4444","date":"2023-11-01","written_by":"independent","quote":"In Brazil, UNDP piloted a best practice in the National Council of Justice’s Artificial Intelligence System to address backlogs and to identify trends in judicial processes that disproportionately impact vulnerable communities. The use of AI enabled courts to focus on urgent cases, streamline case management, and fast-track high-risk cases brought by vulnerable groups, particularly women."}],"replication":{"produced_by":["UNDP worked with the National Council of Justice on its artificial intelligence system.","The work targeted court backlogs and trends in cases that disproportionately affect vulnerable communities.","Courts used the system to single out urgent and high-risk cases."],"must_hold":["Courts must find ways to integrate AI into case management, and the office calls for more attention to this.","UNDP must be ready to provide such support."],"echoes":[]},"paired_incident":null,"headline":"Brazil's court AI helps fast-track cases from vulnerable groups","metric":null,"comparator":null,"later":null,"value":null,"developer_country":null,"deployer_country":"Brazil","unrated_because":"The office states the benefit without figures or a cited source, so its depth cannot be established for any group.","brief_notes":null,"brief":null,"revisions":[{"date":"2026-10-31","change":"Added the record from the finding of the UNDP Independent Evaluation Office.","source":"https://www.unevaluation.org/get-download-file/4444","editor":"AIBD"}],"confidence":"found","shade":"high","claim_status":"Found by an evaluation office","claim_basis":"Sources: one independent evaluation report. The cited evidence includes no independent study or report.","case_jurisdictions":["Brazil"],"profile":{"case_id":"AIBD-0698","catalog_version":"1.0.0","source_fingerprint":"c62024326e8a2164d1843e2411fa3cd68a5ec3708bd0859e51b61801fcbdc093","collection_refs":[{"collection_id":"aibd","version":"2026-10-31"},{"collection_id":"querist","version":"2026-10-25"}],"source_ids":["AIBD-0698-source-0001"],"families":{"strategic assessments":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"evaluations":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"monetary observations":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"institutional decisions":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]}},"fields":{"actors[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"developer":"Not named in the evaluation (the system belongs to the National Council of Justice, CNJ)","deployer":"Brazilian courts under the National Council of Justice (CNJ), with UNDP"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["developer","deployer"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"actors[].ownership_control":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"ai_contribution":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"ai_relationship":{"state":"value_present","value":{"kind":"record_fields","fields":{"category":"program","ai_role":{"status":"unassessed","statement":"The office describes AI and machine learning in the management of court cases in general terms and names no model or tool for the council's system. It gives no comparison of courts with and without the system, so the AI's part is not separated."}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ai_role","category"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].alternatives":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].assessor_date":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].depth":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].display_confidence":{"state":"value_present","value":{"kind":"structured","data":{"confidence":"high","evidence_word":"found","claim_status":"Found by an evaluation office","basis":"Sources: one independent evaluation report. The cited evidence includes no independent study or report.","interpretation":"Existing display rule preserved; the richer outcome-specific confidence question still needs review."}},"provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].rationale":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"organizational","reason":"The office states the effects on case handling without figures or a cited source."},{"group":"personal","reason":"No count of fast-tracked cases from vulnerable groups, including women, is given."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].rubric_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].status_basis":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].target":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"organizational","reason":"The office states the effects on case handling without figures or a cited source."},{"group":"personal","reason":"No count of fast-tracked cases from vulnerable groups, including women, is given."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"availability":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"brief":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"case_kind":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"case_links[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].evidence_links":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].evidence_strength":{"state":"value_present","value":{"kind":"structured","data":{"answer":"Found by an evaluation office. Sources: one independent evaluation report. The cited evidence includes no independent study or report.","evidence_word":"found","claim_status":"Found by an evaluation office"}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0698-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Found by an evaluation office. Sources: one independent evaluation report. The cited evidence includes no independent study or report.","inferred":false}},"claims[].missingness":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].proposition":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"cross_border_flows[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"decisions[].action_outcome":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].grounds":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].institution_task":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].success_criterion":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"deployment_stage":{"state":"value_present","value":{"kind":"structured","data":{"classification":"pilot","answer":"The system was used in a pilot. The office describes the Brazilian work as a trial of a best practice and calls AI a nascent area of UNDP work.","scope":"The period and activity described in the case."}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["account","evidence"],"source_refs":["AIBD-0698-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"The system was used in a pilot. The office describes the Brazilian work as a trial of a best practice and calls AI a nascent area of UNDP work.","inferred":false}},"economics[].amount":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].costs[]":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].counterfactual":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].currency_price_basis":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].gross_net":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].measure_type":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].period_unit":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].realization":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].recipient_payer":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].return_payback":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].valuation_method":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"evaluations[].ai_uplift":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].comparator":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].design":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].effect":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].exposure":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].id":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].measurement_method":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].metric":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].reproduction_materials":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].setting_sample":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].uncertainty_limitations":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"external_references[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"follow_up[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"human_oversight":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"id":{"state":"value_present","value":{"kind":"record_fields","fields":{"id":"AIBD-0698"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["id"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"infrastructure_dependencies[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].beneficiaries":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].beneficiary_count":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].benefit_type":{"state":"value_present","value":{"kind":"record_fields","fields":{"benefit_type":"Improved Organizational Efficiency"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["benefit_type"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].claim":{"state":"value_present","value":{"kind":"record_fields","fields":{"account":"In November 2023, UNDP's Independent Evaluation Office published an evaluation of UNDP support for the digitalization of public services. The team drew on 15 case studies and in-depth studies of countries, desk reviews of 25 countries and interviews. In its section on justice, the office writes that UNDP tested a best practice in the artificial intelligence system of Brazil's National Council of Justice (CNJ). The work aimed to address court backlogs and to identify trends in judicial processes that disproportionately affect vulnerable communities. The office found that the use of AI enabled courts to focus on urgent cases and manage cases more efficiently. It also let them fast-track high-risk cases brought by vulnerable groups, particularly women. The office describes AI in the management of court cases as analysis of data patterns from past cases that predicts or recommends outcomes. The office gives no figures and cites no source for the Brazilian result. It calls AI a nascent area of UNDP work and writes that more attention is needed on how to integrate AI into court management.","benefit_type":"Improved Organizational Efficiency"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["account","benefit_type"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].distribution":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].duration":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].id":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].stakeholder_group":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"organizational","reason":"The office states the effects on case handling without figures or a cited source."},{"group":"personal","reason":"No count of fast-tracked cases from vulnerable groups, including women, is given."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].status":{"state":"value_present","value":{"kind":"record_fields","fields":{"benefit_status":"reported"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["benefit_status"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].tradeoffs":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].unexpected":{"state":"value_present","value":{"kind":"record_fields","fields":{"unexpected":false,"purpose":"The National Council of Justice uses its artificial intelligence system for managing court cases. UNDP's work on it aimed to address backlogs and identify trends in cases that disproportionately affect vulnerable communities."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["unexpected","purpose"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"places[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"location":"Brazil","deployer_country":"Brazil"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["location","deployer_country"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"purpose":{"state":"value_present","value":{"kind":"record_fields","fields":{"purpose":"The National Council of Justice uses its artificial intelligence system for managing court cases. UNDP's work on it aimed to address backlogs and identify trends in cases that disproportionately affect vulnerable communities."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["purpose"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"record_dates":{"state":"value_present","value":{"kind":"record_fields","fields":{"date_observed":"2023-11-01","date_basis":"source publication","date_precision":"month","revisions":[{"date":"2026-10-31","change":"Added the record from the finding of the UNDP Independent Evaluation Office.","source":"https://www.unevaluation.org/get-download-file/4444","editor":"AIBD"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["date_observed","date_basis","date_precision","revisions"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"replication.attempts[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"replication.conditions":{"state":"value_present","value":{"kind":"record_fields","fields":{"replication":{"produced_by":["UNDP worked with the National Council of Justice on its artificial intelligence system.","The work targeted court backlogs and trends in cases that disproportionately affect vulnerable communities.","Courts used the system to single out urgent and high-risk cases."],"must_hold":["Courts must find ways to integrate AI into case management, and the office calls for more attention to this.","UNDP must be ready to provide such support."],"echoes":[]}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["replication"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"revision_history[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"revisions":[{"date":"2026-10-31","change":"Added the record from the finding of the UNDP Independent Evaluation Office.","source":"https://www.unevaluation.org/get-download-file/4444","editor":"AIBD"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["revisions"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sector":{"state":"value_present","value":{"kind":"record_fields","fields":{"domain":"Justice administration: managing court cases"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["domain"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].access_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"sources[].citation_locator":{"state":"value_present","value":{"kind":"record_fields","fields":{"evidence":[{"kind":"evaluation report","citation":"UNDP Independent Evaluation Office. Evaluation of the UNDP Support to Digitalization of Public Services. November 2023. The report is an independent publication of the office. Section on justice and the rule of law.","title":"Evaluation of the UNDP Support to Digitalization of Public Services","url":"https://www.unevaluation.org/get-download-file/4444","date":"2023-11-01","written_by":"independent","quote":"In Brazil, UNDP piloted a best practice in the National Council of Justice’s Artificial Intelligence System to address backlogs and to identify trends in judicial processes that disproportionately impact vulnerable communities. The use of AI enabled courts to focus on urgent cases, streamline case management, and fast-track high-risk cases brought by vulnerable groups, particularly women."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].id":{"state":"value_present","value":{"kind":"identifiers","identifiers":["AIBD-0698-source-0001"],"role":"Existing evidence items, in their original order"},"provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"complete"},"sources[].language":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"sources[].relationship":{"state":"value_present","value":{"kind":"record_fields","fields":{"evidence":[{"kind":"evaluation report","citation":"UNDP Independent Evaluation Office. Evaluation of the UNDP Support to Digitalization of Public Services. November 2023. The report is an independent publication of the office. Section on justice and the rule of law.","title":"Evaluation of the UNDP Support to Digitalization of Public Services","url":"https://www.unevaluation.org/get-download-file/4444","date":"2023-11-01","written_by":"independent","quote":"In Brazil, UNDP piloted a best practice in the National Council of Justice’s Artificial Intelligence System to address backlogs and to identify trends in judicial processes that disproportionately impact vulnerable communities. The use of AI enabled courts to focus on urgent cases, streamline case management, and fast-track high-risk cases brought by vulnerable groups, particularly women."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].upstream_sources":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"strategic_assessments[]":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"strategic assessments"},"summary":{"state":"value_present","value":{"kind":"record_fields","fields":{"summary":"UNDP's evaluation office found that the AI system of Brazil's National Council of Justice let courts prioritize urgent cases and high-risk cases from vulnerable groups.","account":"In November 2023, UNDP's Independent Evaluation Office published an evaluation of UNDP support for the digitalization of public services. The team drew on 15 case studies and in-depth studies of countries, desk reviews of 25 countries and interviews. In its section on justice, the office writes that UNDP tested a best practice in the artificial intelligence system of Brazil's National Council of Justice (CNJ). The work aimed to address court backlogs and to identify trends in judicial processes that disproportionately affect vulnerable communities. The office found that the use of AI enabled courts to focus on urgent cases and manage cases more efficiently. It also let them fast-track high-risk cases brought by vulnerable groups, particularly women. The office describes AI in the management of court cases as analysis of data patterns from past cases that predicts or recommends outcomes. The office gives no figures and cites no source for the Brazilian result. It calls AI a nascent area of UNDP work and writes that more attention is needed on how to integrate AI into court management."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["summary","account"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"systems[].autonomy_permissions":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].component_role":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].deployment_configuration":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].inputs_outputs":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].model_name":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].model_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].product_name":{"state":"value_present","value":{"kind":"record_fields","fields":{"system":"Artificial Intelligence System of Brazil's National Council of Justice (CNJ)"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["system"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"systems[].provider":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"taxonomy_crosswalks[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"title":{"state":"value_present","value":{"kind":"record_fields","fields":{"title":"UNDP's evaluation office finds that the AI system of Brazil's National Council of Justice let courts fast-track high-risk cases from vulnerable groups","headline":"Brazil's court AI helps fast-track cases from vulnerable groups"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["title","headline"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"version":{"state":"value_present","value":{"kind":"identifiers","identifiers":["870f8b9f6b8b5ab13f11614a8deca14bf42d76544f5768116842915c42fdce4d"],"role":"SHA-256 of the complete public record and its assessments"},"provenance":{"kind":"curatorial","basis":"SHA-256 of the public record, its assessments, and its displayed answers and notes, excluding its own identifier and the derived coverage summary.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"complete"},"workflow":{"state":"value_present","value":{"kind":"record_fields","fields":{"account":"In November 2023, UNDP's Independent Evaluation Office published an evaluation of UNDP support for the digitalization of public services. The team drew on 15 case studies and in-depth studies of countries, desk reviews of 25 countries and interviews. In its section on justice, the office writes that UNDP tested a best practice in the artificial intelligence system of Brazil's National Council of Justice (CNJ). The work aimed to address court backlogs and to identify trends in judicial processes that disproportionately affect vulnerable communities. The office found that the use of AI enabled courts to focus on urgent cases and manage cases more efficiently. It also let them fast-track high-risk cases brought by vulnerable groups, particularly women. The office describes AI in the management of court cases as analysis of data patterns from past cases that predicts or recommends outcomes. The office gives no figures and cites no source for the Brazilian result. It calls AI a nascent area of UNDP work and writes that more attention is needed on how to integrate AI into court management.","replication":{"produced_by":["UNDP worked with the National Council of Justice on its artificial intelligence system.","The work targeted court backlogs and trends in cases that disproportionately affect vulnerable communities.","Courts used the system to single out urgent and high-risk cases."],"must_hold":["Courts must find ways to integrate AI into case management, and the office calls for more attention to this.","UNDP must be ready to provide such support."],"echoes":[]}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["account","replication"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"}},"summary":{"total":91,"addressed":91,"known":27,"reviewed":2,"reviewed_complete":2,"reviewed_partial":0,"record_mapped":25,"review_not_assessed":64,"not_assessed":0,"complete":false,"by_state":{"value_present":27,"not_reported":0,"unresolved":64,"not_assessed":0,"not_applicable":0,"withheld":0,"source_unavailable":0}}},"presentation_version":"f01e0afe8008f580743fc3f75d028ded0371028df9e429598b1cfa3a263b9751"}