{"id":"AIBD-1149","title":"Thunder Bay Electronics' evaluator scored the broadcaster's ENCO enCaption4 live captions mostly at or above Canada's 98 standard in 2023-2024","summary":"The broadcaster's certified evaluator scored its automatic ENCO enCaption4 live news captions from 97.65 to 98.61 across 48 samples in 2023-2024, mostly at or above the CRTC's 98.","date_observed":"2024-11-29","date_basis":"source publication","date_precision":"day","benefit_status":"reported","source_collection":null,"source_entry":null,"account":"Thunder Bay Electronics, part of Dougall Media, runs the television stations CKPR-DT and CHFD-DT in Thunder Bay, Ontario. In early 2019 it implemented ENCO's enCaption4 to caption its live programs automatically. Master control operators run and monitor the system and maintain its local lexicon of new and local words. From 1 March 2020 the CRTC required live English-language captions to score at least 98 under the NER model. In 2019 a group of independent stations that included Thunder Bay Electronics had told the CRTC that voice recognition captioning could struggle to meet it. A certified NER evaluator engaged by the broadcaster scored 48 samples of its live news in the 2023-2024 season. Scores ranged from 97.65 to 98.61, and most reached 98. The broadcaster reported that it received no complaints or concerns from viewers. It attributed the lower scores mainly to punctuation and speaker-change detection. No independent check of the scores is reported, and the report gives no earlier figures or comparison with human captions.","category":"aggregate result","unexpected":false,"purpose":"ENCO built enCaption4 to caption live and pre-recorded programs automatically in near real time.","system":"ENCO enCaption4 automated live captioning","model_version":"enCaption4","developer":"ENCO Systems","deployer":"Thunder Bay Electronics Limited (Dougall Media), for CKPR-DT and CHFD-DT","location":"Thunder Bay, Ontario, Canada","domain":"Broadcasting / live closed captions for deaf and hard-of-hearing viewers","segment":null,"benefit_type":"Improved Accessibility","work_activities":["4.A.3.b.6"],"taxonomy_note":null,"registry_ids":{},"ratings":[{"group":"personal","depth":null,"reason":"The evaluator scored the captions near the standard for one season, but the report gives no earlier figures and no outcome for viewers beyond the absence of complaints."}],"ai_role":{"status":"unassessed","statement":"The evaluator scored captions that enCaption4 produced with no captioner at broadcast time, but the report compares them with neither human captions nor earlier results. Staff maintain the system's local lexicon. ENCO says that the enCaption4 engine uses machine learning to build a deep neural network approach to voice recognition."},"evidence":[{"kind":"evaluation report","citation":"Thunder Bay Electronics Limited (Dougall Media), CKPR-DT and CHFD-DT. Annual closed captioning report for the 2023/2024 broadcast season, filed with the CRTC under Broadcasting Regulatory Policy CRTC 2019-308, 29 November 2024, with NER scores by a certified NER evaluator that the broadcaster engaged. Archived copy of https://crtc.gc.ca/eng/BCASTING/ann_rep/tbayelec_cc2024.pdf.","title":"Annual closed captioning report for the 2023/2024 broadcast season, CKPR & CHFD","url":"https://web.archive.org/web/2026id_/https://crtc.gc.ca/eng/BCASTING/ann_rep/tbayelec_cc2024.pdf","date":"2024-11-29","written_by":"evaluator","quote":"Occasionally our NER evaluations score less than 98. The primary cause is punctuation and speaker change detection issues."},{"kind":"evaluation report","citation":"Thunder Bay Electronics Limited (Dougall Media), CKPR-DT and CHFD-DT. Annual closed captioning report for the 2023/2024 broadcast season, filed with the CRTC under Broadcasting Regulatory Policy CRTC 2019-308, 29 November 2024, with NER scores by a certified NER evaluator that the broadcaster engaged. Archived copy of https://crtc.gc.ca/eng/BCASTING/ann_rep/tbayelec_cc2024.pdf.","title":"Annual closed captioning report for the 2023/2024 broadcast season, CKPR & CHFD","url":"https://web.archive.org/web/2026id_/https://crtc.gc.ca/eng/BCASTING/ann_rep/tbayelec_cc2024.pdf","date":"2024-11-29","written_by":"evaluator","quote":"In early 2019, we implemented ENCO's enCaption4 amid positive industry reviews and successful in-house testing.","supports_benefit":false},{"kind":"evaluation report","citation":"Thunder Bay Electronics Limited (Dougall Media), CKPR-DT and CHFD-DT. Annual closed captioning report for the 2023/2024 broadcast season, filed with the CRTC under Broadcasting Regulatory Policy CRTC 2019-308, 29 November 2024, with NER scores by a certified NER evaluator that the broadcaster engaged. Archived copy of https://crtc.gc.ca/eng/BCASTING/ann_rep/tbayelec_cc2024.pdf.","title":"Annual closed captioning report for the 2023/2024 broadcast season, CKPR & CHFD","url":"https://web.archive.org/web/2026id_/https://crtc.gc.ca/eng/BCASTING/ann_rep/tbayelec_cc2024.pdf","date":"2024-11-29","written_by":"evaluator","quote":"During the 2023/2024 broadcast season, we did not receive any complaints or concerns from viewers."},{"kind":"regulatory document","citation":"Canadian Radio-television and Telecommunications Commission. Broadcasting Regulatory Policy CRTC 2019-308: English-language closed captioning mandatory quality standards relating to the accuracy rate for live television programming. Ottawa, 30 August 2019. Archived copy of https://crtc.gc.ca/eng/archive/2019/2019-308.htm. Appendix 1, Quality Standard 3.","title":"Broadcasting Regulatory Policy CRTC 2019-308: English-language closed captioning mandatory quality standards relating to the accuracy rate for live television programming","url":"https://web.archive.org/web/2026id_/https://crtc.gc.ca/eng/archive/2019/2019-308.htm","date":"2019-08-30","written_by":"independent","quote":"Beginning 1 March 2020, broadcasters must reach an accuracy rate of at least 98 for English-language closed captioning of live television programming","supports_benefit":false},{"kind":"regulatory document","citation":"Canadian Radio-television and Telecommunications Commission. Broadcasting Regulatory Policy CRTC 2019-308: English-language closed captioning mandatory quality standards relating to the accuracy rate for live television programming. Ottawa, 30 August 2019. Archived copy of https://crtc.gc.ca/eng/archive/2019/2019-308.htm. Section on requested flexibility for independent broadcasters, relaying the joint intervention of the English-Language Local Independent Television Stations Group (E-ILTS).","title":"Broadcasting Regulatory Policy CRTC 2019-308: English-language closed captioning mandatory quality standards relating to the accuracy rate for live television programming","url":"https://web.archive.org/web/2026id_/https://crtc.gc.ca/eng/archive/2019/2019-308.htm","date":"2019-08-30","written_by":"independent","quote":"Further, E-ILTS acknowledged that voice recognition software, which is sometimes used by independent television stations and allows for costs savings, is improving year by year, but noted that based on preliminary testing, voice recognition-based captioning could have difficulty meeting the proposed NER 98 accuracy standard in the short term.","supports_benefit":false},{"kind":"regulatory document","citation":"Canadian Radio-television and Telecommunications Commission. Broadcasting Regulatory Policy CRTC 2019-308: English-language closed captioning mandatory quality standards relating to the accuracy rate for live television programming. Ottawa, 30 August 2019. Archived copy of https://crtc.gc.ca/eng/archive/2019/2019-308.htm. Footnote 6, the members of E-ILTS.","title":"Broadcasting Regulatory Policy CRTC 2019-308: English-language closed captioning mandatory quality standards relating to the accuracy rate for live television programming","url":"https://web.archive.org/web/2026id_/https://crtc.gc.ca/eng/archive/2019/2019-308.htm","date":"2019-08-30","written_by":"independent","quote":"Jim Pattison Broadcast Group Limited Partnership, operating in Kamloops and Prince George, British Columbia, and Medicine Hat, Alberta; Stingray Digital Group Inc. (now Stingray Group Inc.) in Lloydminster, Alberta; Thunder Bay Electronics Limited in Thunder Bay, Ontario; The Miracle Channel Association in Lethbridge, Alberta;","supports_benefit":false},{"kind":"press release","citation":"ENCO Systems. ENCO to Unveil Automated Closed Captioning Breakthroughs at NAB Show New York. Press release, Southfield, Michigan, 5 October 2017 (enco.com). Accessed 1 November 2026.","title":"ENCO to Unveil Automated Closed Captioning Breakthroughs at NAB Show New York","url":"https://enco.com/blog/enco-to-unveil-automated-closed-captioning-breakthroughs-at-nab-show-new-york","date":"2017-10-05","written_by":"makers","quote":"enCaption4's new speech-to-text engine takes this accuracy to an unprecedented new level, leveraging breakthroughs in machine learning technology to develop a deep neural network approach to voice recognition.","supports_benefit":false}],"replication":{"produced_by":["ENCO's enCaption4 captioned live programs automatically, with a redundant system in case the main one failed.","Master control operators ran the system and monitored its output throughout the day.","Staff maintained the system's local lexicon of new, unusual or local words.","The broadcaster sent its NER evaluations to ENCO to guide software updates."],"must_hold":["Live English-language captions must score at least 98 under the Canadian NER guidelines, as calculated by certified evaluators.","Punctuation and speaker-change detection must improve for scores to stay at or above 98."],"echoes":[]},"paired_incident":null,"headline":"*enCaption4* captions mostly meet Canada's live accuracy standard","metric":"from 97.65 to 98.61 across 48 samples","comparator":null,"later":null,"value":null,"developer_country":"United States","deployer_country":"Canada","unrated_because":"The commissioned scores cover one season, with no baseline and no measured outcome for viewers.","brief_notes":null,"brief":null,"revisions":[{"date":"2026-11-01","change":"Added the record from the report of Thunder Bay Electronics Limited.","source":"https://web.archive.org/web/2026id_/https://crtc.gc.ca/eng/BCASTING/ann_rep/tbayelec_cc2024.pdf","editor":"AIBD"}],"confidence":"claimed","shade":"low","claim_status":"The evaluator's account","claim_basis":"Sources: one independent regulatory document, the makers' press release and the evaluators' evaluation report. For the benefit itself, the cited sources include no independent source and no finding by an external body.","case_jurisdictions":["Canada"],"profile":{"case_id":"AIBD-1149","catalog_version":"1.0.0","source_fingerprint":"5577c5f179104af86113c5e4b8299d1bb2dc4a18cb01187f251aa211cc903476","collection_refs":[{"collection_id":"aibd","version":"2026-10-31"},{"collection_id":"querist","version":"2026-10-25"},{"collection_id":"viator","version":"2026-10-25"}],"source_ids":["AIBD-1149-source-0001","AIBD-1149-source-0002","AIBD-1149-source-0003","AIBD-1149-source-0004","AIBD-1149-source-0005","AIBD-1149-source-0006","AIBD-1149-source-0007"],"families":{"strategic assessments":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"evaluations":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"monetary observations":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"institutional decisions":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]}},"fields":{"actors[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"developer":"ENCO Systems","deployer":"Thunder Bay Electronics Limited (Dougall Media), for CKPR-DT and CHFD-DT"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["developer","deployer"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"actors[].ownership_control":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"ai_contribution":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"ai_relationship":{"state":"value_present","value":{"kind":"record_fields","fields":{"category":"aggregate result","ai_role":{"status":"unassessed","statement":"The evaluator scored captions that enCaption4 produced with no captioner at broadcast time, but the report compares them with neither human captions nor earlier results. Staff maintain the system's local lexicon. ENCO says that the enCaption4 engine uses machine learning to build a deep neural network approach to voice recognition."}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ai_role","category"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].alternatives":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].assessor_date":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].depth":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].display_confidence":{"state":"value_present","value":{"kind":"structured","data":{"confidence":"low","evidence_word":"claimed","claim_status":"The evaluator's account","basis":"Sources: one independent regulatory document, the makers' press release and the evaluators' evaluation report. For the benefit itself, the cited sources include no independent source and no finding by an external body.","interpretation":"Existing display rule preserved; the richer outcome-specific confidence question still needs review."}},"provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].rationale":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"personal","reason":"The evaluator scored the captions near the standard for one season, but the report gives no earlier figures and no outcome for viewers beyond the absence of complaints."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].rubric_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].status_basis":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].target":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"personal","reason":"The evaluator scored the captions near the standard for one season, but the report gives no earlier figures and no outcome for viewers beyond the absence of complaints."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"availability":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"brief":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"case_kind":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"case_links[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].evidence_links":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].evidence_strength":{"state":"value_present","value":{"kind":"structured","data":{"answer":"The evaluator's account. Sources: one independent regulatory document, the makers' press release and the evaluators' evaluation report. For the benefit itself, the cited sources include no independent source and no finding by an external body.","evidence_word":"claimed","claim_status":"The evaluator's account"}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-1149-source-0001","AIBD-1149-source-0002","AIBD-1149-source-0003","AIBD-1149-source-0004","AIBD-1149-source-0005","AIBD-1149-source-0006","AIBD-1149-source-0007"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"The evaluator's account. Sources: one independent regulatory document, the makers' press release and the evaluators' evaluation report. For the benefit itself, the cited sources include no independent source and no finding by an external body.","inferred":false}},"claims[].missingness":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].proposition":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"cross_border_flows[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"decisions[].action_outcome":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].grounds":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].institution_task":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].success_criterion":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"deployment_stage":{"state":"value_present","value":{"kind":"structured","data":{"classification":"routine use","answer":"The system was in routine use. The broadcaster has captioned its live programs with enCaption4 since early 2019 and reported scores for every month of 2023-2024.","scope":"The period and activity described in the case."}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["account","evidence"],"source_refs":["AIBD-1149-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"The system was in routine use. The broadcaster has captioned its live programs with enCaption4 since early 2019 and reported scores for every month of 2023-2024.","inferred":false}},"economics[].amount":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].costs[]":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].counterfactual":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].currency_price_basis":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].gross_net":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].measure_type":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].period_unit":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].realization":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].recipient_payer":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].return_payback":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].valuation_method":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"evaluations[].ai_uplift":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].comparator":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].design":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].effect":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].exposure":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].id":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].measurement_method":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].metric":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].reproduction_materials":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].setting_sample":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].uncertainty_limitations":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"external_references[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"follow_up[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"human_oversight":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"id":{"state":"value_present","value":{"kind":"record_fields","fields":{"id":"AIBD-1149"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["id"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"infrastructure_dependencies[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].beneficiaries":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].beneficiary_count":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].benefit_type":{"state":"value_present","value":{"kind":"record_fields","fields":{"benefit_type":"Improved Accessibility"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["benefit_type"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].claim":{"state":"value_present","value":{"kind":"record_fields","fields":{"account":"Thunder Bay Electronics, part of Dougall Media, runs the television stations CKPR-DT and CHFD-DT in Thunder Bay, Ontario. In early 2019 it implemented ENCO's enCaption4 to caption its live programs automatically. Master control operators run and monitor the system and maintain its local lexicon of new and local words. From 1 March 2020 the CRTC required live English-language captions to score at least 98 under the NER model. In 2019 a group of independent stations that included Thunder Bay Electronics had told the CRTC that voice recognition captioning could struggle to meet it. A certified NER evaluator engaged by the broadcaster scored 48 samples of its live news in the 2023-2024 season. Scores ranged from 97.65 to 98.61, and most reached 98. The broadcaster reported that it received no complaints or concerns from viewers. It attributed the lower scores mainly to punctuation and speaker-change detection. No independent check of the scores is reported, and the report gives no earlier figures or comparison with human captions.","benefit_type":"Improved Accessibility"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["account","benefit_type"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].distribution":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].duration":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].id":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].stakeholder_group":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"personal","reason":"The evaluator scored the captions near the standard for one season, but the report gives no earlier figures and no outcome for viewers beyond the absence of complaints."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].status":{"state":"value_present","value":{"kind":"record_fields","fields":{"benefit_status":"reported"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["benefit_status"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].tradeoffs":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].unexpected":{"state":"value_present","value":{"kind":"record_fields","fields":{"unexpected":false,"purpose":"ENCO built enCaption4 to caption live and pre-recorded programs automatically in near real time."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["unexpected","purpose"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"places[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"location":"Thunder Bay, Ontario, Canada","developer_country":"United States","deployer_country":"Canada"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["location","developer_country","deployer_country"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"purpose":{"state":"value_present","value":{"kind":"record_fields","fields":{"purpose":"ENCO built enCaption4 to caption live and pre-recorded programs automatically in near real time."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["purpose"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"record_dates":{"state":"value_present","value":{"kind":"record_fields","fields":{"date_observed":"2024-11-29","date_basis":"source publication","date_precision":"day","revisions":[{"date":"2026-11-01","change":"Added the record from the report of Thunder Bay Electronics Limited.","source":"https://web.archive.org/web/2026id_/https://crtc.gc.ca/eng/BCASTING/ann_rep/tbayelec_cc2024.pdf","editor":"AIBD"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["date_observed","date_basis","date_precision","revisions"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"replication.attempts[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"replication.conditions":{"state":"value_present","value":{"kind":"record_fields","fields":{"replication":{"produced_by":["ENCO's enCaption4 captioned live programs automatically, with a redundant system in case the main one failed.","Master control operators ran the system and monitored its output throughout the day.","Staff maintained the system's local lexicon of new, unusual or local words.","The broadcaster sent its NER evaluations to ENCO to guide software updates."],"must_hold":["Live English-language captions must score at least 98 under the Canadian NER guidelines, as calculated by certified evaluators.","Punctuation and speaker-change detection must improve for scores to stay at or above 98."],"echoes":[]}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["replication"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"revision_history[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"revisions":[{"date":"2026-11-01","change":"Added the record from the report of Thunder Bay Electronics Limited.","source":"https://web.archive.org/web/2026id_/https://crtc.gc.ca/eng/BCASTING/ann_rep/tbayelec_cc2024.pdf","editor":"AIBD"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["revisions"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sector":{"state":"value_present","value":{"kind":"record_fields","fields":{"domain":"Broadcasting / live closed captions for deaf and hard-of-hearing viewers"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["domain"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].access_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"sources[].citation_locator":{"state":"value_present","value":{"kind":"record_fields","fields":{"evidence":[{"kind":"evaluation report","citation":"Thunder Bay Electronics Limited (Dougall Media), CKPR-DT and CHFD-DT. Annual closed captioning report for the 2023/2024 broadcast season, filed with the CRTC under Broadcasting Regulatory Policy CRTC 2019-308, 29 November 2024, with NER scores by a certified NER evaluator that the broadcaster engaged. Archived copy of https://crtc.gc.ca/eng/BCASTING/ann_rep/tbayelec_cc2024.pdf.","title":"Annual closed captioning report for the 2023/2024 broadcast season, CKPR & CHFD","url":"https://web.archive.org/web/2026id_/https://crtc.gc.ca/eng/BCASTING/ann_rep/tbayelec_cc2024.pdf","date":"2024-11-29","written_by":"evaluator","quote":"Occasionally our NER evaluations score less than 98. The primary cause is punctuation and speaker change detection issues."},{"kind":"evaluation report","citation":"Thunder Bay Electronics Limited (Dougall Media), CKPR-DT and CHFD-DT. Annual closed captioning report for the 2023/2024 broadcast season, filed with the CRTC under Broadcasting Regulatory Policy CRTC 2019-308, 29 November 2024, with NER scores by a certified NER evaluator that the broadcaster engaged. Archived copy of https://crtc.gc.ca/eng/BCASTING/ann_rep/tbayelec_cc2024.pdf.","title":"Annual closed captioning report for the 2023/2024 broadcast season, CKPR & CHFD","url":"https://web.archive.org/web/2026id_/https://crtc.gc.ca/eng/BCASTING/ann_rep/tbayelec_cc2024.pdf","date":"2024-11-29","written_by":"evaluator","quote":"In early 2019, we implemented ENCO's enCaption4 amid positive industry reviews and successful in-house testing.","supports_benefit":false},{"kind":"evaluation report","citation":"Thunder Bay Electronics Limited (Dougall Media), CKPR-DT and CHFD-DT. Annual closed captioning report for the 2023/2024 broadcast season, filed with the CRTC under Broadcasting Regulatory Policy CRTC 2019-308, 29 November 2024, with NER scores by a certified NER evaluator that the broadcaster engaged. Archived copy of https://crtc.gc.ca/eng/BCASTING/ann_rep/tbayelec_cc2024.pdf.","title":"Annual closed captioning report for the 2023/2024 broadcast season, CKPR & CHFD","url":"https://web.archive.org/web/2026id_/https://crtc.gc.ca/eng/BCASTING/ann_rep/tbayelec_cc2024.pdf","date":"2024-11-29","written_by":"evaluator","quote":"During the 2023/2024 broadcast season, we did not receive any complaints or concerns from viewers."},{"kind":"regulatory document","citation":"Canadian Radio-television and Telecommunications Commission. Broadcasting Regulatory Policy CRTC 2019-308: English-language closed captioning mandatory quality standards relating to the accuracy rate for live television programming. Ottawa, 30 August 2019. Archived copy of https://crtc.gc.ca/eng/archive/2019/2019-308.htm. Appendix 1, Quality Standard 3.","title":"Broadcasting Regulatory Policy CRTC 2019-308: English-language closed captioning mandatory quality standards relating to the accuracy rate for live television programming","url":"https://web.archive.org/web/2026id_/https://crtc.gc.ca/eng/archive/2019/2019-308.htm","date":"2019-08-30","written_by":"independent","quote":"Beginning 1 March 2020, broadcasters must reach an accuracy rate of at least 98 for English-language closed captioning of live television programming","supports_benefit":false},{"kind":"regulatory document","citation":"Canadian Radio-television and Telecommunications Commission. Broadcasting Regulatory Policy CRTC 2019-308: English-language closed captioning mandatory quality standards relating to the accuracy rate for live television programming. Ottawa, 30 August 2019. Archived copy of https://crtc.gc.ca/eng/archive/2019/2019-308.htm. Section on requested flexibility for independent broadcasters, relaying the joint intervention of the English-Language Local Independent Television Stations Group (E-ILTS).","title":"Broadcasting Regulatory Policy CRTC 2019-308: English-language closed captioning mandatory quality standards relating to the accuracy rate for live television programming","url":"https://web.archive.org/web/2026id_/https://crtc.gc.ca/eng/archive/2019/2019-308.htm","date":"2019-08-30","written_by":"independent","quote":"Further, E-ILTS acknowledged that voice recognition software, which is sometimes used by independent television stations and allows for costs savings, is improving year by year, but noted that based on preliminary testing, voice recognition-based captioning could have difficulty meeting the proposed NER 98 accuracy standard in the short term.","supports_benefit":false},{"kind":"regulatory document","citation":"Canadian Radio-television and Telecommunications Commission. Broadcasting Regulatory Policy CRTC 2019-308: English-language closed captioning mandatory quality standards relating to the accuracy rate for live television programming. Ottawa, 30 August 2019. Archived copy of https://crtc.gc.ca/eng/archive/2019/2019-308.htm. Footnote 6, the members of E-ILTS.","title":"Broadcasting Regulatory Policy CRTC 2019-308: English-language closed captioning mandatory quality standards relating to the accuracy rate for live television programming","url":"https://web.archive.org/web/2026id_/https://crtc.gc.ca/eng/archive/2019/2019-308.htm","date":"2019-08-30","written_by":"independent","quote":"Jim Pattison Broadcast Group Limited Partnership, operating in Kamloops and Prince George, British Columbia, and Medicine Hat, Alberta; Stingray Digital Group Inc. (now Stingray Group Inc.) in Lloydminster, Alberta; Thunder Bay Electronics Limited in Thunder Bay, Ontario; The Miracle Channel Association in Lethbridge, Alberta;","supports_benefit":false},{"kind":"press release","citation":"ENCO Systems. ENCO to Unveil Automated Closed Captioning Breakthroughs at NAB Show New York. Press release, Southfield, Michigan, 5 October 2017 (enco.com). Accessed 1 November 2026.","title":"ENCO to Unveil Automated Closed Captioning Breakthroughs at NAB Show New York","url":"https://enco.com/blog/enco-to-unveil-automated-closed-captioning-breakthroughs-at-nab-show-new-york","date":"2017-10-05","written_by":"makers","quote":"enCaption4's new speech-to-text engine takes this accuracy to an unprecedented new level, leveraging breakthroughs in machine learning technology to develop a deep neural network approach to voice recognition.","supports_benefit":false}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].id":{"state":"value_present","value":{"kind":"identifiers","identifiers":["AIBD-1149-source-0001","AIBD-1149-source-0002","AIBD-1149-source-0003","AIBD-1149-source-0004","AIBD-1149-source-0005","AIBD-1149-source-0006","AIBD-1149-source-0007"],"role":"Existing evidence items, in their original order"},"provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"complete"},"sources[].language":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"sources[].relationship":{"state":"value_present","value":{"kind":"record_fields","fields":{"evidence":[{"kind":"evaluation report","citation":"Thunder Bay Electronics Limited (Dougall Media), CKPR-DT and CHFD-DT. Annual closed captioning report for the 2023/2024 broadcast season, filed with the CRTC under Broadcasting Regulatory Policy CRTC 2019-308, 29 November 2024, with NER scores by a certified NER evaluator that the broadcaster engaged. Archived copy of https://crtc.gc.ca/eng/BCASTING/ann_rep/tbayelec_cc2024.pdf.","title":"Annual closed captioning report for the 2023/2024 broadcast season, CKPR & CHFD","url":"https://web.archive.org/web/2026id_/https://crtc.gc.ca/eng/BCASTING/ann_rep/tbayelec_cc2024.pdf","date":"2024-11-29","written_by":"evaluator","quote":"Occasionally our NER evaluations score less than 98. The primary cause is punctuation and speaker change detection issues."},{"kind":"evaluation report","citation":"Thunder Bay Electronics Limited (Dougall Media), CKPR-DT and CHFD-DT. Annual closed captioning report for the 2023/2024 broadcast season, filed with the CRTC under Broadcasting Regulatory Policy CRTC 2019-308, 29 November 2024, with NER scores by a certified NER evaluator that the broadcaster engaged. Archived copy of https://crtc.gc.ca/eng/BCASTING/ann_rep/tbayelec_cc2024.pdf.","title":"Annual closed captioning report for the 2023/2024 broadcast season, CKPR & CHFD","url":"https://web.archive.org/web/2026id_/https://crtc.gc.ca/eng/BCASTING/ann_rep/tbayelec_cc2024.pdf","date":"2024-11-29","written_by":"evaluator","quote":"In early 2019, we implemented ENCO's enCaption4 amid positive industry reviews and successful in-house testing.","supports_benefit":false},{"kind":"evaluation report","citation":"Thunder Bay Electronics Limited (Dougall Media), CKPR-DT and CHFD-DT. Annual closed captioning report for the 2023/2024 broadcast season, filed with the CRTC under Broadcasting Regulatory Policy CRTC 2019-308, 29 November 2024, with NER scores by a certified NER evaluator that the broadcaster engaged. Archived copy of https://crtc.gc.ca/eng/BCASTING/ann_rep/tbayelec_cc2024.pdf.","title":"Annual closed captioning report for the 2023/2024 broadcast season, CKPR & CHFD","url":"https://web.archive.org/web/2026id_/https://crtc.gc.ca/eng/BCASTING/ann_rep/tbayelec_cc2024.pdf","date":"2024-11-29","written_by":"evaluator","quote":"During the 2023/2024 broadcast season, we did not receive any complaints or concerns from viewers."},{"kind":"regulatory document","citation":"Canadian Radio-television and Telecommunications Commission. Broadcasting Regulatory Policy CRTC 2019-308: English-language closed captioning mandatory quality standards relating to the accuracy rate for live television programming. Ottawa, 30 August 2019. Archived copy of https://crtc.gc.ca/eng/archive/2019/2019-308.htm. Appendix 1, Quality Standard 3.","title":"Broadcasting Regulatory Policy CRTC 2019-308: English-language closed captioning mandatory quality standards relating to the accuracy rate for live television programming","url":"https://web.archive.org/web/2026id_/https://crtc.gc.ca/eng/archive/2019/2019-308.htm","date":"2019-08-30","written_by":"independent","quote":"Beginning 1 March 2020, broadcasters must reach an accuracy rate of at least 98 for English-language closed captioning of live television programming","supports_benefit":false},{"kind":"regulatory document","citation":"Canadian Radio-television and Telecommunications Commission. Broadcasting Regulatory Policy CRTC 2019-308: English-language closed captioning mandatory quality standards relating to the accuracy rate for live television programming. Ottawa, 30 August 2019. Archived copy of https://crtc.gc.ca/eng/archive/2019/2019-308.htm. Section on requested flexibility for independent broadcasters, relaying the joint intervention of the English-Language Local Independent Television Stations Group (E-ILTS).","title":"Broadcasting Regulatory Policy CRTC 2019-308: English-language closed captioning mandatory quality standards relating to the accuracy rate for live television programming","url":"https://web.archive.org/web/2026id_/https://crtc.gc.ca/eng/archive/2019/2019-308.htm","date":"2019-08-30","written_by":"independent","quote":"Further, E-ILTS acknowledged that voice recognition software, which is sometimes used by independent television stations and allows for costs savings, is improving year by year, but noted that based on preliminary testing, voice recognition-based captioning could have difficulty meeting the proposed NER 98 accuracy standard in the short term.","supports_benefit":false},{"kind":"regulatory document","citation":"Canadian Radio-television and Telecommunications Commission. Broadcasting Regulatory Policy CRTC 2019-308: English-language closed captioning mandatory quality standards relating to the accuracy rate for live television programming. Ottawa, 30 August 2019. Archived copy of https://crtc.gc.ca/eng/archive/2019/2019-308.htm. Footnote 6, the members of E-ILTS.","title":"Broadcasting Regulatory Policy CRTC 2019-308: English-language closed captioning mandatory quality standards relating to the accuracy rate for live television programming","url":"https://web.archive.org/web/2026id_/https://crtc.gc.ca/eng/archive/2019/2019-308.htm","date":"2019-08-30","written_by":"independent","quote":"Jim Pattison Broadcast Group Limited Partnership, operating in Kamloops and Prince George, British Columbia, and Medicine Hat, Alberta; Stingray Digital Group Inc. (now Stingray Group Inc.) in Lloydminster, Alberta; Thunder Bay Electronics Limited in Thunder Bay, Ontario; The Miracle Channel Association in Lethbridge, Alberta;","supports_benefit":false},{"kind":"press release","citation":"ENCO Systems. ENCO to Unveil Automated Closed Captioning Breakthroughs at NAB Show New York. Press release, Southfield, Michigan, 5 October 2017 (enco.com). Accessed 1 November 2026.","title":"ENCO to Unveil Automated Closed Captioning Breakthroughs at NAB Show New York","url":"https://enco.com/blog/enco-to-unveil-automated-closed-captioning-breakthroughs-at-nab-show-new-york","date":"2017-10-05","written_by":"makers","quote":"enCaption4's new speech-to-text engine takes this accuracy to an unprecedented new level, leveraging breakthroughs in machine learning technology to develop a deep neural network approach to voice recognition.","supports_benefit":false}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].upstream_sources":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"strategic_assessments[]":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"strategic assessments"},"summary":{"state":"value_present","value":{"kind":"record_fields","fields":{"summary":"The broadcaster's certified evaluator scored its automatic ENCO enCaption4 live news captions from 97.65 to 98.61 across 48 samples in 2023-2024, mostly at or above the CRTC's 98.","account":"Thunder Bay Electronics, part of Dougall Media, runs the television stations CKPR-DT and CHFD-DT in Thunder Bay, Ontario. In early 2019 it implemented ENCO's enCaption4 to caption its live programs automatically. Master control operators run and monitor the system and maintain its local lexicon of new and local words. From 1 March 2020 the CRTC required live English-language captions to score at least 98 under the NER model. In 2019 a group of independent stations that included Thunder Bay Electronics had told the CRTC that voice recognition captioning could struggle to meet it. A certified NER evaluator engaged by the broadcaster scored 48 samples of its live news in the 2023-2024 season. Scores ranged from 97.65 to 98.61, and most reached 98. The broadcaster reported that it received no complaints or concerns from viewers. It attributed the lower scores mainly to punctuation and speaker-change detection. No independent check of the scores is reported, and the report gives no earlier figures or comparison with human captions."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["summary","account"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"systems[].autonomy_permissions":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].component_role":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].deployment_configuration":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].inputs_outputs":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].model_name":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].model_version":{"state":"value_present","value":{"kind":"record_fields","fields":{"model_version":"enCaption4"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["model_version"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"systems[].product_name":{"state":"value_present","value":{"kind":"record_fields","fields":{"system":"ENCO enCaption4 automated live captioning"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["system"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"systems[].provider":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"taxonomy_crosswalks[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"title":{"state":"value_present","value":{"kind":"record_fields","fields":{"title":"Thunder Bay Electronics' evaluator scored the broadcaster's ENCO enCaption4 live captions mostly at or above Canada's 98 standard in 2023-2024","headline":"*enCaption4* captions mostly meet Canada's live accuracy standard"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["title","headline"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"version":{"state":"value_present","value":{"kind":"identifiers","identifiers":["d6bf9219b20474ba863fe8fc9dd2fc7da6ae99fbbef284dc04ae11ada2b4c96a"],"role":"SHA-256 of the complete public record and its assessments"},"provenance":{"kind":"curatorial","basis":"SHA-256 of the public record, its assessments, and its displayed answers and notes, excluding its own identifier and the derived coverage summary.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"complete"},"workflow":{"state":"value_present","value":{"kind":"record_fields","fields":{"account":"Thunder Bay Electronics, part of Dougall Media, runs the television stations CKPR-DT and CHFD-DT in Thunder Bay, Ontario. In early 2019 it implemented ENCO's enCaption4 to caption its live programs automatically. Master control operators run and monitor the system and maintain its local lexicon of new and local words. From 1 March 2020 the CRTC required live English-language captions to score at least 98 under the NER model. In 2019 a group of independent stations that included Thunder Bay Electronics had told the CRTC that voice recognition captioning could struggle to meet it. A certified NER evaluator engaged by the broadcaster scored 48 samples of its live news in the 2023-2024 season. Scores ranged from 97.65 to 98.61, and most reached 98. The broadcaster reported that it received no complaints or concerns from viewers. It attributed the lower scores mainly to punctuation and speaker-change detection. No independent check of the scores is reported, and the report gives no earlier figures or comparison with human captions.","replication":{"produced_by":["ENCO's enCaption4 captioned live programs automatically, with a redundant system in case the main one failed.","Master control operators ran the system and monitored its output throughout the day.","Staff maintained the system's local lexicon of new, unusual or local words.","The broadcaster sent its NER evaluations to ENCO to guide software updates."],"must_hold":["Live English-language captions must score at least 98 under the Canadian NER guidelines, as calculated by certified evaluators.","Punctuation and speaker-change detection must improve for scores to stay at or above 98."],"echoes":[]}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["account","replication"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"}},"summary":{"total":91,"addressed":91,"known":28,"reviewed":2,"reviewed_complete":2,"reviewed_partial":0,"record_mapped":26,"review_not_assessed":63,"not_assessed":0,"complete":false,"by_state":{"value_present":28,"not_reported":0,"unresolved":63,"not_assessed":0,"not_applicable":0,"withheld":0,"source_unavailable":0}}},"presentation_version":"b577789592e0b1d2f6f67fead6edce7f9f2eb089d2ee34b2afd53c89ae0080a8"}