{"id":"AIBD-0821","title":"The FCC certifies MachineGenius's automatic Olelo captions after MITRE's tests measured fewer word errors than in human-assisted captions","summary":"In testing for the FCC, MachineGenius's fully automatic phone captions had average error rates of 2.7% to 8.2%, against 8.9% to 19.5% for providers that use human assistants.","date_observed":"2020-05-05","date_basis":"source publication","date_precision":"day","benefit_status":"intended","source_collection":null,"source_entry":null,"account":"Internet Protocol Captioned Telephone Service lets people with hearing loss read captions of a phone call while they listen. MachineGenius applied to provide the service through its Olelo app with automatic speech recognition alone, without communications assistants. The FCC's research contractor MITRE tested the service in March 2020. It used the same call scenarios on which it had tested providers that rely on assistants in 2018 and 2019. MachineGenius's average error rates ranged from 2.7% to 8.2%, against 8.9% to 19.5% for the assisted providers. Its captions arrived in 1.1 to 1.4 seconds, against 4.8 to 6.8 seconds. On 5 May 2020, the FCC's Consumer and Governmental Affairs Bureau granted conditional certification. The Bureau wrote that, by MITRE's tests, the captions appear more accurate and faster than what was then available. It required quarterly reports of complaints in the first year, pending a check of the service in actual operation. The speech recognizer came from a vendor that the FCC does not name.","category":"aggregate result","unexpected":false,"purpose":"MachineGenius built Olelo to give people with hearing loss captions of their phone calls, produced by automatic speech recognition alone.","system":"Olelo, MachineGenius's ASR-only Internet Protocol Captioned Telephone Service (IP CTS)","model_version":null,"developer":"MachineGenius, Inc. (speech recognition licensed from an unnamed vendor)","deployer":"MachineGenius, Inc.","location":"United States","domain":"Telecommunications relay services / accessibility for people with hearing loss","segment":null,"benefit_type":"Improved Task Accuracy","work_activities":["4.A.3.b.6"],"taxonomy_note":"The captions serve people with hearing loss, but only the accuracy and delay of test calls are documented.","registry_ids":{},"ratings":[{"group":"personal","depth":null,"reason":"The service had not yet captioned users' calls when the FCC ruled, so the gain is a test result."}],"ai_role":{"status":"assessed","statement":"MITRE measured the automatic captions against captions from human-assisted providers on the same call scenarios, which isolates the recognizer's output. The assisted providers were tested in 2018 and 2019 and MachineGenius in March 2020. The FCC notes that MachineGenius's agreement with its vendor bars using its calls to \"train\" the recognizer, which indicates a trained model."},"evidence":[{"kind":"regulatory document","citation":"Federal Communications Commission, Consumer and Governmental Affairs Bureau. Memorandum Opinion and Order, DA 20-485, CG Docket No. 03-123 (conditional certification of MachineGenius, Inc. to provide IP CTS using only automatic speech recognition). Adopted and released 5 May 2020.","title":"Memorandum Opinion and Order, DA 20-485 (MachineGenius, Inc.)","url":"https://docs.fcc.gov/public/attachments/DA-20-485A1.pdf","date":"2020-05-05","written_by":"independent","quote":"In the recent MITRE testing, MachineGenius’s average word error rates for various call scenarios ranged from 2.7% to 8.2%, while CA-assisted providers’ average word error rates were significantly higher, ranging from 8.9% to 19.5%."},{"kind":"other","citation":"Sorenson. Olelo Captioned Calls (machinegenius.com). Accessed 31 October 2026.","title":"Olelo Captioned Calls","url":"https://www.machinegenius.com/","date":null,"written_by":"makers","quote":"An official FCC study rated Olelo — now CaptionCall Mobile — the most accurate captioned call provider."}],"replication":{"produced_by":["Automatic speech recognition produced the captions with no communications assistant.","MachineGenius chose its recognizer after comparing leading vendors on accuracy, formatting and the handling of numbers.","Calls ran over SIP trunks to the Olelo app on users' own phones and tablets."],"must_hold":["The service must meet the FCC's minimum standards in actual operation.","Neither the provider nor its vendor may keep call content after the call."],"echoes":[]},"paired_incident":null,"headline":"*Olelo* phone captions beat human-assisted ones in FCC testing","metric":"average error rates of 2.7% to 8.2%","comparator":{"against":"CA-assisted IP CTS providers, tested on the same call scenarios in 2018 and 2019","before":"8.9% to 19.5% average error rates","after":"2.7% to 8.2%","basis":"measured","quote":"In the recent MITRE testing, MachineGenius’s average word error rates for various call scenarios ranged from 2.7% to 8.2%, while CA-assisted providers’ average word error rates were significantly higher, ranging from 8.9% to 19.5%.","url":"https://docs.fcc.gov/public/attachments/DA-20-485A1.pdf"},"later":{"status":"persisted","date":null,"note":"Sorenson writes on the app's site that Olelo is now CaptionCall Mobile, part of CaptionCall by Sorenson.","quote":"Olelo is now CaptionCall Mobile","url":"https://www.machinegenius.com/"},"value":null,"developer_country":null,"deployer_country":null,"unrated_because":"The FCC certified the service on test results before it served users, so no outcome for callers is reported.","brief_notes":null,"brief":null,"revisions":[{"date":"2026-10-31","change":"Added the record from the finding of the FCC.","source":"https://docs.fcc.gov/public/attachments/DA-20-485A1.pdf","editor":"AIBD"}],"confidence":"found","shade":"high","claim_status":"Found by a regulator","claim_basis":"Sources: one independent regulatory document and the makers' other source. The cited evidence includes no independent study or report.","case_jurisdictions":["United States"],"profile":{"case_id":"AIBD-0821","catalog_version":"1.0.0","source_fingerprint":"a84c30dd07a076ef7f107f71580fd27f28768c81a3fd9242b48d411383ce1d9b","collection_refs":[{"collection_id":"aibd","version":"2026-10-31"},{"collection_id":"querist","version":"2026-10-25"}],"source_ids":["AIBD-0821-source-0001","AIBD-0821-source-0002"],"families":{"strategic assessments":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"evaluations":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"monetary observations":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"institutional decisions":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]}},"fields":{"actors[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"developer":"MachineGenius, Inc. (speech recognition licensed from an unnamed vendor)","deployer":"MachineGenius, Inc."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["developer","deployer"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"actors[].ownership_control":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"ai_contribution":{"state":"value_present","value":{"kind":"record_fields","fields":{"ai_role":{"status":"assessed","statement":"MITRE measured the automatic captions against captions from human-assisted providers on the same call scenarios, which isolates the recognizer's output. The assisted providers were tested in 2018 and 2019 and MachineGenius in March 2020. The FCC notes that MachineGenius's agreement with its vendor bars using its calls to \"train\" the recognizer, which indicates a trained model."}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ai_role"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"ai_relationship":{"state":"value_present","value":{"kind":"record_fields","fields":{"category":"aggregate result","ai_role":{"status":"assessed","statement":"MITRE measured the automatic captions against captions from human-assisted providers on the same call scenarios, which isolates the recognizer's output. The assisted providers were tested in 2018 and 2019 and MachineGenius in March 2020. The FCC notes that MachineGenius's agreement with its vendor bars using its calls to \"train\" the recognizer, which indicates a trained model."}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ai_role","category"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].alternatives":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].assessor_date":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].depth":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].display_confidence":{"state":"value_present","value":{"kind":"structured","data":{"confidence":"high","evidence_word":"found","claim_status":"Found by a regulator","basis":"Sources: one independent regulatory document and the makers' other source. The cited evidence includes no independent study or report.","interpretation":"Existing display rule preserved; the richer outcome-specific confidence question still needs review."}},"provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].rationale":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"personal","reason":"The service had not yet captioned users' calls when the FCC ruled, so the gain is a test result."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].rubric_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].status_basis":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].target":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"personal","reason":"The service had not yet captioned users' calls when the FCC ruled, so the gain is a test result."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"availability":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"brief":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"case_kind":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"case_links[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].evidence_links":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].evidence_strength":{"state":"value_present","value":{"kind":"structured","data":{"answer":"Found by a regulator. Sources: one independent regulatory document and the makers' other source. The cited evidence includes no independent study or report.","evidence_word":"found","claim_status":"Found by a regulator"}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0821-source-0001","AIBD-0821-source-0002"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Found by a regulator. Sources: one independent regulatory document and the makers' other source. The cited evidence includes no independent study or report.","inferred":false}},"claims[].missingness":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].proposition":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"cross_border_flows[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"decisions[].action_outcome":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].grounds":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].institution_task":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].success_criterion":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"deployment_stage":{"state":"value_present","value":{"kind":"structured","data":{"classification":"laboratory test","answer":"The system was tested in a laboratory. MITRE tested the service on set call scenarios before it captioned any user's call.","scope":"The period and activity described in the case."}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["account","evidence"],"source_refs":["AIBD-0821-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"The system was tested in a laboratory. MITRE tested the service on set call scenarios before it captioned any user's call.","inferred":false}},"economics[].amount":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].costs[]":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].counterfactual":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].currency_price_basis":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].gross_net":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].measure_type":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].period_unit":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].realization":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].recipient_payer":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].return_payback":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].valuation_method":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"evaluations[].ai_uplift":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].comparator":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].design":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].effect":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].exposure":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].id":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].measurement_method":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].metric":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].reproduction_materials":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].setting_sample":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].uncertainty_limitations":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"external_references[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"follow_up[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"later":{"status":"persisted","note":"Sorenson writes on the app's site that Olelo is now CaptionCall Mobile, part of CaptionCall by Sorenson.","quote":"Olelo is now CaptionCall Mobile","url":"https://www.machinegenius.com/"}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["later"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"human_oversight":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"id":{"state":"value_present","value":{"kind":"record_fields","fields":{"id":"AIBD-0821"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["id"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"infrastructure_dependencies[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].beneficiaries":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].beneficiary_count":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].benefit_type":{"state":"value_present","value":{"kind":"record_fields","fields":{"benefit_type":"Improved Task Accuracy","taxonomy_note":"The captions serve people with hearing loss, but only the accuracy and delay of test calls are documented."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["benefit_type","taxonomy_note"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].claim":{"state":"value_present","value":{"kind":"record_fields","fields":{"account":"Internet Protocol Captioned Telephone Service lets people with hearing loss read captions of a phone call while they listen. MachineGenius applied to provide the service through its Olelo app with automatic speech recognition alone, without communications assistants. The FCC's research contractor MITRE tested the service in March 2020. It used the same call scenarios on which it had tested providers that rely on assistants in 2018 and 2019. MachineGenius's average error rates ranged from 2.7% to 8.2%, against 8.9% to 19.5% for the assisted providers. Its captions arrived in 1.1 to 1.4 seconds, against 4.8 to 6.8 seconds. On 5 May 2020, the FCC's Consumer and Governmental Affairs Bureau granted conditional certification. The Bureau wrote that, by MITRE's tests, the captions appear more accurate and faster than what was then available. It required quarterly reports of complaints in the first year, pending a check of the service in actual operation. The speech recognizer came from a vendor that the FCC does not name.","benefit_type":"Improved Task Accuracy"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["account","benefit_type"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].distribution":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].duration":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].id":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].stakeholder_group":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"personal","reason":"The service had not yet captioned users' calls when the FCC ruled, so the gain is a test result."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].status":{"state":"value_present","value":{"kind":"record_fields","fields":{"benefit_status":"intended"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["benefit_status"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].tradeoffs":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].unexpected":{"state":"value_present","value":{"kind":"record_fields","fields":{"unexpected":false,"purpose":"MachineGenius built Olelo to give people with hearing loss captions of their phone calls, produced by automatic speech recognition alone."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["unexpected","purpose"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"places[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"location":"United States"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["location"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"purpose":{"state":"value_present","value":{"kind":"record_fields","fields":{"purpose":"MachineGenius built Olelo to give people with hearing loss captions of their phone calls, produced by automatic speech recognition alone."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["purpose"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"record_dates":{"state":"value_present","value":{"kind":"record_fields","fields":{"date_observed":"2020-05-05","date_basis":"source publication","date_precision":"day","revisions":[{"date":"2026-10-31","change":"Added the record from the finding of the FCC.","source":"https://docs.fcc.gov/public/attachments/DA-20-485A1.pdf","editor":"AIBD"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["date_observed","date_basis","date_precision","revisions"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"replication.attempts[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"replication.conditions":{"state":"value_present","value":{"kind":"record_fields","fields":{"replication":{"produced_by":["Automatic speech recognition produced the captions with no communications assistant.","MachineGenius chose its recognizer after comparing leading vendors on accuracy, formatting and the handling of numbers.","Calls ran over SIP trunks to the Olelo app on users' own phones and tablets."],"must_hold":["The service must meet the FCC's minimum standards in actual operation.","Neither the provider nor its vendor may keep call content after the call."],"echoes":[]}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["replication"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"revision_history[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"revisions":[{"date":"2026-10-31","change":"Added the record from the finding of the FCC.","source":"https://docs.fcc.gov/public/attachments/DA-20-485A1.pdf","editor":"AIBD"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["revisions"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sector":{"state":"value_present","value":{"kind":"record_fields","fields":{"domain":"Telecommunications relay services / accessibility for people with hearing loss"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["domain"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].access_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"sources[].citation_locator":{"state":"value_present","value":{"kind":"record_fields","fields":{"evidence":[{"kind":"regulatory document","citation":"Federal Communications Commission, Consumer and Governmental Affairs Bureau. Memorandum Opinion and Order, DA 20-485, CG Docket No. 03-123 (conditional certification of MachineGenius, Inc. to provide IP CTS using only automatic speech recognition). Adopted and released 5 May 2020.","title":"Memorandum Opinion and Order, DA 20-485 (MachineGenius, Inc.)","url":"https://docs.fcc.gov/public/attachments/DA-20-485A1.pdf","date":"2020-05-05","written_by":"independent","quote":"In the recent MITRE testing, MachineGenius’s average word error rates for various call scenarios ranged from 2.7% to 8.2%, while CA-assisted providers’ average word error rates were significantly higher, ranging from 8.9% to 19.5%."},{"kind":"other","citation":"Sorenson. Olelo Captioned Calls (machinegenius.com). Accessed 31 October 2026.","title":"Olelo Captioned Calls","url":"https://www.machinegenius.com/","written_by":"makers","quote":"An official FCC study rated Olelo — now CaptionCall Mobile — the most accurate captioned call provider."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].id":{"state":"value_present","value":{"kind":"identifiers","identifiers":["AIBD-0821-source-0001","AIBD-0821-source-0002"],"role":"Existing evidence items, in their original order"},"provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"complete"},"sources[].language":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"sources[].relationship":{"state":"value_present","value":{"kind":"record_fields","fields":{"evidence":[{"kind":"regulatory document","citation":"Federal Communications Commission, Consumer and Governmental Affairs Bureau. Memorandum Opinion and Order, DA 20-485, CG Docket No. 03-123 (conditional certification of MachineGenius, Inc. to provide IP CTS using only automatic speech recognition). Adopted and released 5 May 2020.","title":"Memorandum Opinion and Order, DA 20-485 (MachineGenius, Inc.)","url":"https://docs.fcc.gov/public/attachments/DA-20-485A1.pdf","date":"2020-05-05","written_by":"independent","quote":"In the recent MITRE testing, MachineGenius’s average word error rates for various call scenarios ranged from 2.7% to 8.2%, while CA-assisted providers’ average word error rates were significantly higher, ranging from 8.9% to 19.5%."},{"kind":"other","citation":"Sorenson. Olelo Captioned Calls (machinegenius.com). Accessed 31 October 2026.","title":"Olelo Captioned Calls","url":"https://www.machinegenius.com/","written_by":"makers","quote":"An official FCC study rated Olelo — now CaptionCall Mobile — the most accurate captioned call provider."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].upstream_sources":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"strategic_assessments[]":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"strategic assessments"},"summary":{"state":"value_present","value":{"kind":"record_fields","fields":{"summary":"In testing for the FCC, MachineGenius's fully automatic phone captions had average error rates of 2.7% to 8.2%, against 8.9% to 19.5% for providers that use human assistants.","account":"Internet Protocol Captioned Telephone Service lets people with hearing loss read captions of a phone call while they listen. MachineGenius applied to provide the service through its Olelo app with automatic speech recognition alone, without communications assistants. The FCC's research contractor MITRE tested the service in March 2020. It used the same call scenarios on which it had tested providers that rely on assistants in 2018 and 2019. MachineGenius's average error rates ranged from 2.7% to 8.2%, against 8.9% to 19.5% for the assisted providers. Its captions arrived in 1.1 to 1.4 seconds, against 4.8 to 6.8 seconds. On 5 May 2020, the FCC's Consumer and Governmental Affairs Bureau granted conditional certification. The Bureau wrote that, by MITRE's tests, the captions appear more accurate and faster than what was then available. It required quarterly reports of complaints in the first year, pending a check of the service in actual operation. The speech recognizer came from a vendor that the FCC does not name."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["summary","account"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"systems[].autonomy_permissions":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].component_role":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].deployment_configuration":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].inputs_outputs":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].model_name":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].model_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].product_name":{"state":"value_present","value":{"kind":"record_fields","fields":{"system":"Olelo, MachineGenius's ASR-only Internet Protocol Captioned Telephone Service (IP CTS)"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["system"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"systems[].provider":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"taxonomy_crosswalks[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"title":{"state":"value_present","value":{"kind":"record_fields","fields":{"title":"The FCC certifies MachineGenius's automatic Olelo captions after MITRE's tests measured fewer word errors than in human-assisted captions","headline":"*Olelo* phone captions beat human-assisted ones in FCC testing"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["title","headline"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"version":{"state":"value_present","value":{"kind":"identifiers","identifiers":["3fec0ef9d702f328064ba86eee063d837a9edb765679bfc28185ce06a82c3661"],"role":"SHA-256 of the complete public record and its assessments"},"provenance":{"kind":"curatorial","basis":"SHA-256 of the public record, its assessments, and its displayed answers and notes, excluding its own identifier and the derived coverage summary.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"complete"},"workflow":{"state":"value_present","value":{"kind":"record_fields","fields":{"account":"Internet Protocol Captioned Telephone Service lets people with hearing loss read captions of a phone call while they listen. MachineGenius applied to provide the service through its Olelo app with automatic speech recognition alone, without communications assistants. The FCC's research contractor MITRE tested the service in March 2020. It used the same call scenarios on which it had tested providers that rely on assistants in 2018 and 2019. MachineGenius's average error rates ranged from 2.7% to 8.2%, against 8.9% to 19.5% for the assisted providers. Its captions arrived in 1.1 to 1.4 seconds, against 4.8 to 6.8 seconds. On 5 May 2020, the FCC's Consumer and Governmental Affairs Bureau granted conditional certification. The Bureau wrote that, by MITRE's tests, the captions appear more accurate and faster than what was then available. It required quarterly reports of complaints in the first year, pending a check of the service in actual operation. The speech recognizer came from a vendor that the FCC does not name.","replication":{"produced_by":["Automatic speech recognition produced the captions with no communications assistant.","MachineGenius chose its recognizer after comparing leading vendors on accuracy, formatting and the handling of numbers.","Calls ran over SIP trunks to the Olelo app on users' own phones and tablets."],"must_hold":["The service must meet the FCC's minimum standards in actual operation.","Neither the provider nor its vendor may keep call content after the call."],"echoes":[]}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["account","replication"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"}},"summary":{"total":91,"addressed":91,"known":29,"reviewed":2,"reviewed_complete":2,"reviewed_partial":0,"record_mapped":27,"review_not_assessed":62,"not_assessed":0,"complete":false,"by_state":{"value_present":29,"not_reported":0,"unresolved":62,"not_assessed":0,"not_applicable":0,"withheld":0,"source_unavailable":0}}},"presentation_version":"6242882433abfa2768717e35b4804a2920a7c10c809f4492cb81401665acda90"}