{"id":"AIBD-1148","title":"Romero-Fresco and Fresno find that Jim Pattison Broadcast Group's fully automatic Enco captions consistently met Canada's live accuracy standard","summary":"Researchers who analyzed reports to the CRTC found that Pattison's automatic Enco captions were slightly below Canada's standard in 2019-2020 and consistently above it in 2020-2021.","date_observed":"2023-12-13","date_basis":"source publication","date_precision":"day","benefit_status":"reported","source_collection":null,"source_entry":null,"account":"Jim Pattison Broadcast Group runs television stations in Kamloops and Prince George in British Columbia and in Medicine Hat in Alberta. It captions its live local programs with Enco's software, with no human captioner. From 1 March 2020 the CRTC required live English-language captions to score at least 98 under the NER model. In 2019 independent stations including Pattison had told the CRTC that voice recognition captioning could struggle to meet it. Pablo Romero-Fresco, who developed the model, and Nazaret Fresno analyzed the broadcasters' reports to the CRTC. Citing Pattison's report, they note that its captions were too variable and slightly below the standard in 2019-2020. Pattison then met regularly with Enco, added local names to the software each month and loaded newsroom scripts before broadcast. In 2020-2021 the lowest of its 31 samples scored 97.8%. With the Miracle Channel, 52 of 55 samples reached 98%. The broadcaster chose its samples and trained an employee as a certified evaluator. Across the broadcasters studied, 60% of automatic samples missed the threshold.","category":"aggregate result","unexpected":false,"purpose":"Enco built its captioning software to turn the speech in live programs into closed captions automatically.","system":"Enco automated captioning software for live local programs (fully automatic captions)","model_version":null,"developer":"ENCO Systems (Enco), product not named in the study","deployer":"Jim Pattison Broadcast Group Limited Partnership","location":"Kamloops and Prince George (British Columbia) and Medicine Hat (Alberta), Canada","domain":"Broadcasting / live closed captions for deaf and hard-of-hearing viewers","segment":null,"benefit_type":"Improved Accessibility","work_activities":["4.A.3.b.6"],"taxonomy_note":null,"registry_ids":{},"ratings":[{"group":"personal","depth":2,"reason":"The study reports that the broadcaster's automatic captions went from too variable and slightly below the standard in 2019-2020 to consistently above it in 2020-2021."}],"ai_role":{"status":"unassessed","statement":"The NER scores measure captions that Enco's software produced with no captioner at broadcast time, but no document compares the same programs captioned by people. Staff word lists and newsroom scripts loaded before broadcast contributed to the gains. The study describes Enco's product as speech recognition software but does not show that it learns from data. ENCO describes its enCaption software as AI that combines machine learning with speech-to-text conversion."},"evidence":[{"kind":"peer-reviewed study","citation":"Romero-Fresco P, Fresno N. The accuracy of automatic and human live captions in English. Linguistica Antverpiensia, New Series: Themes in Translation Studies 22 (2023): 114-133, section 3.4 (case study 4: live TV captions in Canada). Published 13 December 2023. doi:10.52034/lans-tts.v22i.774.","title":"The accuracy of automatic and human live captions in English","url":"https://lans-tts.uantwerpen.be/index.php/LANS-TTS/article/download/774/669","date":"2023-12-13","written_by":"independent","quote":"for the first time, broadcasters such as Jim Pattison Broadcast Group and The Miracle Channel Associations consistently reach accuracy rates above the required threshold in 2020-2021. Impressively, of the 55 samples analysed by these two broadcasters in 2020-2021, 52 reached 98%."},{"kind":"peer-reviewed study","citation":"Romero-Fresco P, Fresno N. The accuracy of automatic and human live captions in English. Linguistica Antverpiensia, New Series: Themes in Translation Studies 22 (2023): 114-133, section 3.4 (case study 4: live TV captions in Canada). Published 13 December 2023. doi:10.52034/lans-tts.v22i.774.","title":"The accuracy of automatic and human live captions in English","url":"https://lans-tts.uantwerpen.be/index.php/LANS-TTS/article/download/774/669","date":"2023-12-13","written_by":"independent","quote":"By 2021, in the second round of live captions analysed in Canada, the lowest accuracy rates obtained in the 31 samples analysed by Jim Pattison Broadcast Group and in the 24 samples analysed by The Miracle Channel Associations were 97.8% and 97.9%, respectively."},{"kind":"peer-reviewed study","citation":"Romero-Fresco P, Fresno N. The accuracy of automatic and human live captions in English. Linguistica Antverpiensia, New Series: Themes in Translation Studies 22 (2023): 114-133, section 3.4 (case study 4: live TV captions in Canada). Published 13 December 2023. doi:10.52034/lans-tts.v22i.774. List of the improvements that the broadcaster reported to the CRTC.","title":"The accuracy of automatic and human live captions in English","url":"https://lans-tts.uantwerpen.be/index.php/LANS-TTS/article/download/774/669","date":"2023-12-13","written_by":"independent","quote":"meeting regularly with Enco, the manufacturer of the captioning software, to review the accuracy reports;","supports_benefit":false},{"kind":"peer-reviewed study","citation":"Romero-Fresco P, Fresno N. The accuracy of automatic and human live captions in English. Linguistica Antverpiensia, New Series: Themes in Translation Studies 22 (2023): 114-133, section 3.4 (case study 4: live TV captions in Canada). Published 13 December 2023. doi:10.52034/lans-tts.v22i.774.","title":"The accuracy of automatic and human live captions in English","url":"https://lans-tts.uantwerpen.be/index.php/LANS-TTS/article/download/774/669","date":"2023-12-13","written_by":"independent","quote":"They are also more accurate than automatic captions, which feature more samples below 98% accuracy and fewer samples exceeding a 99% accuracy rate (60% of the automatic samples did not reach the minimum threshold and only 1% featured an excellent accuracy).","supports_benefit":false},{"kind":"regulatory document","citation":"Canadian Radio-television and Telecommunications Commission. Broadcasting Regulatory Policy CRTC 2019-308: English-language closed captioning mandatory quality standards relating to the accuracy rate for live television programming. Ottawa, 30 August 2019. Archived copy of https://crtc.gc.ca/eng/archive/2019/2019-308.htm. Appendix 1, Quality Standard 3.","title":"Broadcasting Regulatory Policy CRTC 2019-308: English-language closed captioning mandatory quality standards relating to the accuracy rate for live television programming","url":"https://web.archive.org/web/2026id_/https://crtc.gc.ca/eng/archive/2019/2019-308.htm","date":"2019-08-30","written_by":"independent","quote":"Beginning 1 March 2020, broadcasters must reach an accuracy rate of at least 98 for English-language closed captioning of live television programming","supports_benefit":false},{"kind":"regulatory document","citation":"Canadian Radio-television and Telecommunications Commission. Broadcasting Regulatory Policy CRTC 2019-308: English-language closed captioning mandatory quality standards relating to the accuracy rate for live television programming. Ottawa, 30 August 2019. Archived copy of https://crtc.gc.ca/eng/archive/2019/2019-308.htm. Section on requested flexibility for independent broadcasters, relaying the joint intervention of the English-Language Local Independent Television Stations Group (E-ILTS).","title":"Broadcasting Regulatory Policy CRTC 2019-308: English-language closed captioning mandatory quality standards relating to the accuracy rate for live television programming","url":"https://web.archive.org/web/2026id_/https://crtc.gc.ca/eng/archive/2019/2019-308.htm","date":"2019-08-30","written_by":"independent","quote":"Further, E-ILTS acknowledged that voice recognition software, which is sometimes used by independent television stations and allows for costs savings, is improving year by year, but noted that based on preliminary testing, voice recognition-based captioning could have difficulty meeting the proposed NER 98 accuracy standard in the short term.","supports_benefit":false},{"kind":"regulatory document","citation":"Canadian Radio-television and Telecommunications Commission. Broadcasting Regulatory Policy CRTC 2019-308: English-language closed captioning mandatory quality standards relating to the accuracy rate for live television programming. Ottawa, 30 August 2019. Archived copy of https://crtc.gc.ca/eng/archive/2019/2019-308.htm. Footnote 6, the members of E-ILTS.","title":"Broadcasting Regulatory Policy CRTC 2019-308: English-language closed captioning mandatory quality standards relating to the accuracy rate for live television programming","url":"https://web.archive.org/web/2026id_/https://crtc.gc.ca/eng/archive/2019/2019-308.htm","date":"2019-08-30","written_by":"independent","quote":"Jim Pattison Broadcast Group Limited Partnership, operating in Kamloops and Prince George, British Columbia, and Medicine Hat, Alberta; Stingray Digital Group Inc. (now Stingray Group Inc.) in Lloydminster, Alberta; Thunder Bay Electronics Limited in Thunder Bay, Ontario; The Miracle Channel Association in Lethbridge, Alberta;","supports_benefit":false},{"kind":"other","citation":"ENCO Systems. enCaption product page (enco.com). Accessed 1 November 2026.","title":"enCaption","url":"https://www.enco.com/products/encaption","date":null,"written_by":"makers","quote":"enCaption is an AI software solution that automatically generates captions and time-stamped transcripts on-premise, in the Cloud or as a hybrid solution. Our captioning approach combines machine learning with advanced speech-to-text conversion and grammatical structure analysis to deliver exceptional accuracy with extremely low latency.","supports_benefit":false}],"replication":{"produced_by":["Enco's software produced fully automatic captions for the broadcaster's live programs.","Managers met regularly with Enco to review the accuracy reports.","Staff added commonly used words and local names to the software each month and removed words no longer needed.","Newsroom scripts were loaded into the captioning software before broadcast."],"must_hold":["Live English-language captions must score at least 98 under the Canadian NER guidelines, as calculated by certified evaluators.","Remote news and panel discussions need particular care, since poor audio, cross talk and fast speech affect automatic captions.","Automatic captions need effective human help to reach the threshold regularly."],"echoes":[]},"paired_incident":null,"headline":"*Enco* captions reach Canada's accuracy standard at Pattison stations","metric":"the lowest of its 31 samples scored 97.8%","comparator":{"against":"The broadcaster's automatic captions in 2019-2020","before":"too variable and slightly below the required standards","after":"consistently reach accuracy rates above the required threshold in 2020-2021","basis":"measured","quote":"for the first time, broadcasters such as Jim Pattison Broadcast Group and The Miracle Channel Associations consistently reach accuracy rates above the required threshold in 2020-2021. Impressively, of the 55 samples analysed by these two broadcasters in 2020-2021, 52 reached 98%. As explained in the report produced by Jim Pattison Broadcast Group (2020), the results obtained by their automatic captions in 2019-2020 were too variable and slightly below the required standards.","url":"https://lans-tts.uantwerpen.be/index.php/LANS-TTS/article/download/774/669"},"later":null,"value":null,"developer_country":"United States","deployer_country":"Canada","unrated_because":null,"brief_notes":null,"brief":null,"revisions":[{"date":"2026-11-01","change":"Added the record from the finding of Pablo Romero-Fresco and Nazaret Fresno.","source":"https://lans-tts.uantwerpen.be/index.php/LANS-TTS/article/download/774/669","editor":"AIBD"}],"confidence":"studied","shade":"high","claim_status":"Independently studied","claim_basis":"Sources: one independent regulatory document, one independent peer-reviewed study and the makers' other source. For the benefit itself, the cited sources include no finding by an external body.","case_jurisdictions":["Canada"],"profile":{"case_id":"AIBD-1148","catalog_version":"1.0.0","source_fingerprint":"60f087cc215c67941124ff2c263364b455feb31d959941cfde92227415714a39","collection_refs":[{"collection_id":"aibd","version":"2026-10-31"},{"collection_id":"querist","version":"2026-10-25"},{"collection_id":"viator","version":"2026-10-25"}],"source_ids":["AIBD-1148-source-0001","AIBD-1148-source-0002","AIBD-1148-source-0003","AIBD-1148-source-0004","AIBD-1148-source-0005","AIBD-1148-source-0006","AIBD-1148-source-0007","AIBD-1148-source-0008"],"families":{"strategic assessments":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"evaluations":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"monetary observations":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"institutional decisions":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]}},"fields":{"actors[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"developer":"ENCO Systems (Enco), product not named in the study","deployer":"Jim Pattison Broadcast Group Limited Partnership"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["developer","deployer"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"actors[].ownership_control":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"ai_contribution":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"ai_relationship":{"state":"value_present","value":{"kind":"record_fields","fields":{"category":"aggregate result","ai_role":{"status":"unassessed","statement":"The NER scores measure captions that Enco's software produced with no captioner at broadcast time, but no document compares the same programs captioned by people. Staff word lists and newsroom scripts loaded before broadcast contributed to the gains. The study describes Enco's product as speech recognition software but does not show that it learns from data. ENCO describes its enCaption software as AI that combines machine learning with speech-to-text conversion."}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ai_role","category"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].alternatives":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].assessor_date":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].depth":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"personal","depth":2,"reason":"The study reports that the broadcaster's automatic captions went from too variable and slightly below the standard in 2019-2020 to consistently above it in 2020-2021."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].display_confidence":{"state":"value_present","value":{"kind":"structured","data":{"confidence":"high","evidence_word":"studied","claim_status":"Independently studied","basis":"Sources: one independent regulatory document, one independent peer-reviewed study and the makers' other source. For the benefit itself, the cited sources include no finding by an external body.","interpretation":"Existing display rule preserved; the richer outcome-specific confidence question still needs review."}},"provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].rationale":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"personal","depth":2,"reason":"The study reports that the broadcaster's automatic captions went from too variable and slightly below the standard in 2019-2020 to consistently above it in 2020-2021."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].rubric_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].status_basis":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].target":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"personal","depth":2,"reason":"The study reports that the broadcaster's automatic captions went from too variable and slightly below the standard in 2019-2020 to consistently above it in 2020-2021."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"availability":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"brief":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"case_kind":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"case_links[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].evidence_links":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].evidence_strength":{"state":"value_present","value":{"kind":"structured","data":{"answer":"Independently studied. Sources: one independent regulatory document, one independent peer-reviewed study and the makers' other source. For the benefit itself, the cited sources include no finding by an external body.","evidence_word":"studied","claim_status":"Independently studied"}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-1148-source-0001","AIBD-1148-source-0002","AIBD-1148-source-0003","AIBD-1148-source-0004","AIBD-1148-source-0005","AIBD-1148-source-0006","AIBD-1148-source-0007","AIBD-1148-source-0008"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Independently studied. Sources: one independent regulatory document, one independent peer-reviewed study and the makers' other source. For the benefit itself, the cited sources include no finding by an external body.","inferred":false}},"claims[].missingness":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].proposition":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"cross_border_flows[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"decisions[].action_outcome":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].grounds":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].institution_task":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].success_criterion":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"deployment_stage":{"state":"value_present","value":{"kind":"structured","data":{"classification":"routine use","answer":"The system was in routine use. The study reports that the broadcaster captioned its live programs with Enco's software through the 2020-2021 broadcast year.","scope":"The period and activity described in the case."}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["account","evidence"],"source_refs":["AIBD-1148-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"The system was in routine use. The study reports that the broadcaster captioned its live programs with Enco's software through the 2020-2021 broadcast year.","inferred":false}},"economics[].amount":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].costs[]":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].counterfactual":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].currency_price_basis":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].gross_net":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].measure_type":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].period_unit":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].realization":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].recipient_payer":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].return_payback":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].valuation_method":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"evaluations[].ai_uplift":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].comparator":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].design":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].effect":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].exposure":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].id":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].measurement_method":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].metric":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].reproduction_materials":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].setting_sample":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].uncertainty_limitations":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"external_references[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"follow_up[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"human_oversight":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"id":{"state":"value_present","value":{"kind":"record_fields","fields":{"id":"AIBD-1148"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["id"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"infrastructure_dependencies[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].beneficiaries":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].beneficiary_count":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].benefit_type":{"state":"value_present","value":{"kind":"record_fields","fields":{"benefit_type":"Improved Accessibility"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["benefit_type"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].claim":{"state":"value_present","value":{"kind":"record_fields","fields":{"account":"Jim Pattison Broadcast Group runs television stations in Kamloops and Prince George in British Columbia and in Medicine Hat in Alberta. It captions its live local programs with Enco's software, with no human captioner. From 1 March 2020 the CRTC required live English-language captions to score at least 98 under the NER model. In 2019 independent stations including Pattison had told the CRTC that voice recognition captioning could struggle to meet it. Pablo Romero-Fresco, who developed the model, and Nazaret Fresno analyzed the broadcasters' reports to the CRTC. Citing Pattison's report, they note that its captions were too variable and slightly below the standard in 2019-2020. Pattison then met regularly with Enco, added local names to the software each month and loaded newsroom scripts before broadcast. In 2020-2021 the lowest of its 31 samples scored 97.8%. With the Miracle Channel, 52 of 55 samples reached 98%. The broadcaster chose its samples and trained an employee as a certified evaluator. Across the broadcasters studied, 60% of automatic samples missed the threshold.","benefit_type":"Improved Accessibility"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["account","benefit_type"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].distribution":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].duration":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].id":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].stakeholder_group":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"personal","depth":2,"reason":"The study reports that the broadcaster's automatic captions went from too variable and slightly below the standard in 2019-2020 to consistently above it in 2020-2021."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].status":{"state":"value_present","value":{"kind":"record_fields","fields":{"benefit_status":"reported"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["benefit_status"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].tradeoffs":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].unexpected":{"state":"value_present","value":{"kind":"record_fields","fields":{"unexpected":false,"purpose":"Enco built its captioning software to turn the speech in live programs into closed captions automatically."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["unexpected","purpose"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"places[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"location":"Kamloops and Prince George (British Columbia) and Medicine Hat (Alberta), Canada","developer_country":"United States","deployer_country":"Canada"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["location","developer_country","deployer_country"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"purpose":{"state":"value_present","value":{"kind":"record_fields","fields":{"purpose":"Enco built its captioning software to turn the speech in live programs into closed captions automatically."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["purpose"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"record_dates":{"state":"value_present","value":{"kind":"record_fields","fields":{"date_observed":"2023-12-13","date_basis":"source publication","date_precision":"day","revisions":[{"date":"2026-11-01","change":"Added the record from the finding of Pablo Romero-Fresco and Nazaret Fresno.","source":"https://lans-tts.uantwerpen.be/index.php/LANS-TTS/article/download/774/669","editor":"AIBD"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["date_observed","date_basis","date_precision","revisions"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"replication.attempts[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"replication.conditions":{"state":"value_present","value":{"kind":"record_fields","fields":{"replication":{"produced_by":["Enco's software produced fully automatic captions for the broadcaster's live programs.","Managers met regularly with Enco to review the accuracy reports.","Staff added commonly used words and local names to the software each month and removed words no longer needed.","Newsroom scripts were loaded into the captioning software before broadcast."],"must_hold":["Live English-language captions must score at least 98 under the Canadian NER guidelines, as calculated by certified evaluators.","Remote news and panel discussions need particular care, since poor audio, cross talk and fast speech affect automatic captions.","Automatic captions need effective human help to reach the threshold regularly."],"echoes":[]}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["replication"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"revision_history[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"revisions":[{"date":"2026-11-01","change":"Added the record from the finding of Pablo Romero-Fresco and Nazaret Fresno.","source":"https://lans-tts.uantwerpen.be/index.php/LANS-TTS/article/download/774/669","editor":"AIBD"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["revisions"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sector":{"state":"value_present","value":{"kind":"record_fields","fields":{"domain":"Broadcasting / live closed captions for deaf and hard-of-hearing viewers"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["domain"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].access_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"sources[].citation_locator":{"state":"value_present","value":{"kind":"record_fields","fields":{"evidence":[{"kind":"peer-reviewed study","citation":"Romero-Fresco P, Fresno N. The accuracy of automatic and human live captions in English. Linguistica Antverpiensia, New Series: Themes in Translation Studies 22 (2023): 114-133, section 3.4 (case study 4: live TV captions in Canada). Published 13 December 2023. doi:10.52034/lans-tts.v22i.774.","title":"The accuracy of automatic and human live captions in English","url":"https://lans-tts.uantwerpen.be/index.php/LANS-TTS/article/download/774/669","date":"2023-12-13","written_by":"independent","quote":"for the first time, broadcasters such as Jim Pattison Broadcast Group and The Miracle Channel Associations consistently reach accuracy rates above the required threshold in 2020-2021. Impressively, of the 55 samples analysed by these two broadcasters in 2020-2021, 52 reached 98%."},{"kind":"peer-reviewed study","citation":"Romero-Fresco P, Fresno N. The accuracy of automatic and human live captions in English. Linguistica Antverpiensia, New Series: Themes in Translation Studies 22 (2023): 114-133, section 3.4 (case study 4: live TV captions in Canada). Published 13 December 2023. doi:10.52034/lans-tts.v22i.774.","title":"The accuracy of automatic and human live captions in English","url":"https://lans-tts.uantwerpen.be/index.php/LANS-TTS/article/download/774/669","date":"2023-12-13","written_by":"independent","quote":"By 2021, in the second round of live captions analysed in Canada, the lowest accuracy rates obtained in the 31 samples analysed by Jim Pattison Broadcast Group and in the 24 samples analysed by The Miracle Channel Associations were 97.8% and 97.9%, respectively."},{"kind":"peer-reviewed study","citation":"Romero-Fresco P, Fresno N. The accuracy of automatic and human live captions in English. Linguistica Antverpiensia, New Series: Themes in Translation Studies 22 (2023): 114-133, section 3.4 (case study 4: live TV captions in Canada). Published 13 December 2023. doi:10.52034/lans-tts.v22i.774. List of the improvements that the broadcaster reported to the CRTC.","title":"The accuracy of automatic and human live captions in English","url":"https://lans-tts.uantwerpen.be/index.php/LANS-TTS/article/download/774/669","date":"2023-12-13","written_by":"independent","quote":"meeting regularly with Enco, the manufacturer of the captioning software, to review the accuracy reports;","supports_benefit":false},{"kind":"peer-reviewed study","citation":"Romero-Fresco P, Fresno N. The accuracy of automatic and human live captions in English. Linguistica Antverpiensia, New Series: Themes in Translation Studies 22 (2023): 114-133, section 3.4 (case study 4: live TV captions in Canada). Published 13 December 2023. doi:10.52034/lans-tts.v22i.774.","title":"The accuracy of automatic and human live captions in English","url":"https://lans-tts.uantwerpen.be/index.php/LANS-TTS/article/download/774/669","date":"2023-12-13","written_by":"independent","quote":"They are also more accurate than automatic captions, which feature more samples below 98% accuracy and fewer samples exceeding a 99% accuracy rate (60% of the automatic samples did not reach the minimum threshold and only 1% featured an excellent accuracy).","supports_benefit":false},{"kind":"regulatory document","citation":"Canadian Radio-television and Telecommunications Commission. Broadcasting Regulatory Policy CRTC 2019-308: English-language closed captioning mandatory quality standards relating to the accuracy rate for live television programming. Ottawa, 30 August 2019. Archived copy of https://crtc.gc.ca/eng/archive/2019/2019-308.htm. Appendix 1, Quality Standard 3.","title":"Broadcasting Regulatory Policy CRTC 2019-308: English-language closed captioning mandatory quality standards relating to the accuracy rate for live television programming","url":"https://web.archive.org/web/2026id_/https://crtc.gc.ca/eng/archive/2019/2019-308.htm","date":"2019-08-30","written_by":"independent","quote":"Beginning 1 March 2020, broadcasters must reach an accuracy rate of at least 98 for English-language closed captioning of live television programming","supports_benefit":false},{"kind":"regulatory document","citation":"Canadian Radio-television and Telecommunications Commission. Broadcasting Regulatory Policy CRTC 2019-308: English-language closed captioning mandatory quality standards relating to the accuracy rate for live television programming. Ottawa, 30 August 2019. Archived copy of https://crtc.gc.ca/eng/archive/2019/2019-308.htm. Section on requested flexibility for independent broadcasters, relaying the joint intervention of the English-Language Local Independent Television Stations Group (E-ILTS).","title":"Broadcasting Regulatory Policy CRTC 2019-308: English-language closed captioning mandatory quality standards relating to the accuracy rate for live television programming","url":"https://web.archive.org/web/2026id_/https://crtc.gc.ca/eng/archive/2019/2019-308.htm","date":"2019-08-30","written_by":"independent","quote":"Further, E-ILTS acknowledged that voice recognition software, which is sometimes used by independent television stations and allows for costs savings, is improving year by year, but noted that based on preliminary testing, voice recognition-based captioning could have difficulty meeting the proposed NER 98 accuracy standard in the short term.","supports_benefit":false},{"kind":"regulatory document","citation":"Canadian Radio-television and Telecommunications Commission. Broadcasting Regulatory Policy CRTC 2019-308: English-language closed captioning mandatory quality standards relating to the accuracy rate for live television programming. Ottawa, 30 August 2019. Archived copy of https://crtc.gc.ca/eng/archive/2019/2019-308.htm. Footnote 6, the members of E-ILTS.","title":"Broadcasting Regulatory Policy CRTC 2019-308: English-language closed captioning mandatory quality standards relating to the accuracy rate for live television programming","url":"https://web.archive.org/web/2026id_/https://crtc.gc.ca/eng/archive/2019/2019-308.htm","date":"2019-08-30","written_by":"independent","quote":"Jim Pattison Broadcast Group Limited Partnership, operating in Kamloops and Prince George, British Columbia, and Medicine Hat, Alberta; Stingray Digital Group Inc. (now Stingray Group Inc.) in Lloydminster, Alberta; Thunder Bay Electronics Limited in Thunder Bay, Ontario; The Miracle Channel Association in Lethbridge, Alberta;","supports_benefit":false},{"kind":"other","citation":"ENCO Systems. enCaption product page (enco.com). Accessed 1 November 2026.","title":"enCaption","url":"https://www.enco.com/products/encaption","written_by":"makers","quote":"enCaption is an AI software solution that automatically generates captions and time-stamped transcripts on-premise, in the Cloud or as a hybrid solution. Our captioning approach combines machine learning with advanced speech-to-text conversion and grammatical structure analysis to deliver exceptional accuracy with extremely low latency.","supports_benefit":false}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].id":{"state":"value_present","value":{"kind":"identifiers","identifiers":["AIBD-1148-source-0001","AIBD-1148-source-0002","AIBD-1148-source-0003","AIBD-1148-source-0004","AIBD-1148-source-0005","AIBD-1148-source-0006","AIBD-1148-source-0007","AIBD-1148-source-0008"],"role":"Existing evidence items, in their original order"},"provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"complete"},"sources[].language":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"sources[].relationship":{"state":"value_present","value":{"kind":"record_fields","fields":{"evidence":[{"kind":"peer-reviewed study","citation":"Romero-Fresco P, Fresno N. The accuracy of automatic and human live captions in English. Linguistica Antverpiensia, New Series: Themes in Translation Studies 22 (2023): 114-133, section 3.4 (case study 4: live TV captions in Canada). Published 13 December 2023. doi:10.52034/lans-tts.v22i.774.","title":"The accuracy of automatic and human live captions in English","url":"https://lans-tts.uantwerpen.be/index.php/LANS-TTS/article/download/774/669","date":"2023-12-13","written_by":"independent","quote":"for the first time, broadcasters such as Jim Pattison Broadcast Group and The Miracle Channel Associations consistently reach accuracy rates above the required threshold in 2020-2021. Impressively, of the 55 samples analysed by these two broadcasters in 2020-2021, 52 reached 98%."},{"kind":"peer-reviewed study","citation":"Romero-Fresco P, Fresno N. The accuracy of automatic and human live captions in English. Linguistica Antverpiensia, New Series: Themes in Translation Studies 22 (2023): 114-133, section 3.4 (case study 4: live TV captions in Canada). Published 13 December 2023. doi:10.52034/lans-tts.v22i.774.","title":"The accuracy of automatic and human live captions in English","url":"https://lans-tts.uantwerpen.be/index.php/LANS-TTS/article/download/774/669","date":"2023-12-13","written_by":"independent","quote":"By 2021, in the second round of live captions analysed in Canada, the lowest accuracy rates obtained in the 31 samples analysed by Jim Pattison Broadcast Group and in the 24 samples analysed by The Miracle Channel Associations were 97.8% and 97.9%, respectively."},{"kind":"peer-reviewed study","citation":"Romero-Fresco P, Fresno N. The accuracy of automatic and human live captions in English. Linguistica Antverpiensia, New Series: Themes in Translation Studies 22 (2023): 114-133, section 3.4 (case study 4: live TV captions in Canada). Published 13 December 2023. doi:10.52034/lans-tts.v22i.774. List of the improvements that the broadcaster reported to the CRTC.","title":"The accuracy of automatic and human live captions in English","url":"https://lans-tts.uantwerpen.be/index.php/LANS-TTS/article/download/774/669","date":"2023-12-13","written_by":"independent","quote":"meeting regularly with Enco, the manufacturer of the captioning software, to review the accuracy reports;","supports_benefit":false},{"kind":"peer-reviewed study","citation":"Romero-Fresco P, Fresno N. The accuracy of automatic and human live captions in English. Linguistica Antverpiensia, New Series: Themes in Translation Studies 22 (2023): 114-133, section 3.4 (case study 4: live TV captions in Canada). Published 13 December 2023. doi:10.52034/lans-tts.v22i.774.","title":"The accuracy of automatic and human live captions in English","url":"https://lans-tts.uantwerpen.be/index.php/LANS-TTS/article/download/774/669","date":"2023-12-13","written_by":"independent","quote":"They are also more accurate than automatic captions, which feature more samples below 98% accuracy and fewer samples exceeding a 99% accuracy rate (60% of the automatic samples did not reach the minimum threshold and only 1% featured an excellent accuracy).","supports_benefit":false},{"kind":"regulatory document","citation":"Canadian Radio-television and Telecommunications Commission. Broadcasting Regulatory Policy CRTC 2019-308: English-language closed captioning mandatory quality standards relating to the accuracy rate for live television programming. Ottawa, 30 August 2019. Archived copy of https://crtc.gc.ca/eng/archive/2019/2019-308.htm. Appendix 1, Quality Standard 3.","title":"Broadcasting Regulatory Policy CRTC 2019-308: English-language closed captioning mandatory quality standards relating to the accuracy rate for live television programming","url":"https://web.archive.org/web/2026id_/https://crtc.gc.ca/eng/archive/2019/2019-308.htm","date":"2019-08-30","written_by":"independent","quote":"Beginning 1 March 2020, broadcasters must reach an accuracy rate of at least 98 for English-language closed captioning of live television programming","supports_benefit":false},{"kind":"regulatory document","citation":"Canadian Radio-television and Telecommunications Commission. Broadcasting Regulatory Policy CRTC 2019-308: English-language closed captioning mandatory quality standards relating to the accuracy rate for live television programming. Ottawa, 30 August 2019. Archived copy of https://crtc.gc.ca/eng/archive/2019/2019-308.htm. Section on requested flexibility for independent broadcasters, relaying the joint intervention of the English-Language Local Independent Television Stations Group (E-ILTS).","title":"Broadcasting Regulatory Policy CRTC 2019-308: English-language closed captioning mandatory quality standards relating to the accuracy rate for live television programming","url":"https://web.archive.org/web/2026id_/https://crtc.gc.ca/eng/archive/2019/2019-308.htm","date":"2019-08-30","written_by":"independent","quote":"Further, E-ILTS acknowledged that voice recognition software, which is sometimes used by independent television stations and allows for costs savings, is improving year by year, but noted that based on preliminary testing, voice recognition-based captioning could have difficulty meeting the proposed NER 98 accuracy standard in the short term.","supports_benefit":false},{"kind":"regulatory document","citation":"Canadian Radio-television and Telecommunications Commission. Broadcasting Regulatory Policy CRTC 2019-308: English-language closed captioning mandatory quality standards relating to the accuracy rate for live television programming. Ottawa, 30 August 2019. Archived copy of https://crtc.gc.ca/eng/archive/2019/2019-308.htm. Footnote 6, the members of E-ILTS.","title":"Broadcasting Regulatory Policy CRTC 2019-308: English-language closed captioning mandatory quality standards relating to the accuracy rate for live television programming","url":"https://web.archive.org/web/2026id_/https://crtc.gc.ca/eng/archive/2019/2019-308.htm","date":"2019-08-30","written_by":"independent","quote":"Jim Pattison Broadcast Group Limited Partnership, operating in Kamloops and Prince George, British Columbia, and Medicine Hat, Alberta; Stingray Digital Group Inc. (now Stingray Group Inc.) in Lloydminster, Alberta; Thunder Bay Electronics Limited in Thunder Bay, Ontario; The Miracle Channel Association in Lethbridge, Alberta;","supports_benefit":false},{"kind":"other","citation":"ENCO Systems. enCaption product page (enco.com). Accessed 1 November 2026.","title":"enCaption","url":"https://www.enco.com/products/encaption","written_by":"makers","quote":"enCaption is an AI software solution that automatically generates captions and time-stamped transcripts on-premise, in the Cloud or as a hybrid solution. Our captioning approach combines machine learning with advanced speech-to-text conversion and grammatical structure analysis to deliver exceptional accuracy with extremely low latency.","supports_benefit":false}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].upstream_sources":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"strategic_assessments[]":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"strategic assessments"},"summary":{"state":"value_present","value":{"kind":"record_fields","fields":{"summary":"Researchers who analyzed reports to the CRTC found that Pattison's automatic Enco captions were slightly below Canada's standard in 2019-2020 and consistently above it in 2020-2021.","account":"Jim Pattison Broadcast Group runs television stations in Kamloops and Prince George in British Columbia and in Medicine Hat in Alberta. It captions its live local programs with Enco's software, with no human captioner. From 1 March 2020 the CRTC required live English-language captions to score at least 98 under the NER model. In 2019 independent stations including Pattison had told the CRTC that voice recognition captioning could struggle to meet it. Pablo Romero-Fresco, who developed the model, and Nazaret Fresno analyzed the broadcasters' reports to the CRTC. Citing Pattison's report, they note that its captions were too variable and slightly below the standard in 2019-2020. Pattison then met regularly with Enco, added local names to the software each month and loaded newsroom scripts before broadcast. In 2020-2021 the lowest of its 31 samples scored 97.8%. With the Miracle Channel, 52 of 55 samples reached 98%. The broadcaster chose its samples and trained an employee as a certified evaluator. Across the broadcasters studied, 60% of automatic samples missed the threshold."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["summary","account"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"systems[].autonomy_permissions":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].component_role":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].deployment_configuration":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].inputs_outputs":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].model_name":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].model_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].product_name":{"state":"value_present","value":{"kind":"record_fields","fields":{"system":"Enco automated captioning software for live local programs (fully automatic captions)"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["system"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"systems[].provider":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"taxonomy_crosswalks[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"title":{"state":"value_present","value":{"kind":"record_fields","fields":{"title":"Romero-Fresco and Fresno find that Jim Pattison Broadcast Group's fully automatic Enco captions consistently met Canada's live accuracy standard","headline":"*Enco* captions reach Canada's accuracy standard at Pattison stations"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["title","headline"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"version":{"state":"value_present","value":{"kind":"identifiers","identifiers":["f003fff10749a99065ec5f892dc0cbad5c622f5f63cfeaed0ee1ae4715ebdbf0"],"role":"SHA-256 of the complete public record and its assessments"},"provenance":{"kind":"curatorial","basis":"SHA-256 of the public record, its assessments, and its displayed answers and notes, excluding its own identifier and the derived coverage summary.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"complete"},"workflow":{"state":"value_present","value":{"kind":"record_fields","fields":{"account":"Jim Pattison Broadcast Group runs television stations in Kamloops and Prince George in British Columbia and in Medicine Hat in Alberta. It captions its live local programs with Enco's software, with no human captioner. From 1 March 2020 the CRTC required live English-language captions to score at least 98 under the NER model. In 2019 independent stations including Pattison had told the CRTC that voice recognition captioning could struggle to meet it. Pablo Romero-Fresco, who developed the model, and Nazaret Fresno analyzed the broadcasters' reports to the CRTC. Citing Pattison's report, they note that its captions were too variable and slightly below the standard in 2019-2020. Pattison then met regularly with Enco, added local names to the software each month and loaded newsroom scripts before broadcast. In 2020-2021 the lowest of its 31 samples scored 97.8%. With the Miracle Channel, 52 of 55 samples reached 98%. The broadcaster chose its samples and trained an employee as a certified evaluator. Across the broadcasters studied, 60% of automatic samples missed the threshold.","replication":{"produced_by":["Enco's software produced fully automatic captions for the broadcaster's live programs.","Managers met regularly with Enco to review the accuracy reports.","Staff added commonly used words and local names to the software each month and removed words no longer needed.","Newsroom scripts were loaded into the captioning software before broadcast."],"must_hold":["Live English-language captions must score at least 98 under the Canadian NER guidelines, as calculated by certified evaluators.","Remote news and panel discussions need particular care, since poor audio, cross talk and fast speech affect automatic captions.","Automatic captions need effective human help to reach the threshold regularly."],"echoes":[]}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["account","replication"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"}},"summary":{"total":91,"addressed":91,"known":28,"reviewed":2,"reviewed_complete":2,"reviewed_partial":0,"record_mapped":26,"review_not_assessed":63,"not_assessed":0,"complete":false,"by_state":{"value_present":28,"not_reported":0,"unresolved":63,"not_assessed":0,"not_applicable":0,"withheld":0,"source_unavailable":0}}},"presentation_version":"740b346478cfbb268c8bc03a1f56f52b2172f1047bd6ac02e07bbc5071e37966"}