{"id":"AIBD-0662","title":"Independent Munich study finds that tuned BirdNET comes close to expert bird identification from city recordings","summary":"TU Munich researchers compared BirdNET with two experts on 15.5 hours of rooftop recordings; with tuned settings BirdNET reached an F1 score of 0.84 and found one species the experts missed.","date_observed":"2025-09-11","date_basis":"source publication","date_precision":"day","benefit_status":"reported","source_collection":null,"source_entry":null,"account":"Researchers at the Technical University of Munich placed an acoustic recorder on the roof of a housing complex in Munich, Germany, and between June and October 2021 recorded one minute in every ten around sunrise over 60 days, for 15.5 hours of audio. Two experts identified every bird call. The team ran BirdNET, a deep-learning bird sound recognizer from the Cornell Lab of Ornithology and Chemnitz University of Technology, with 24 combinations of settings at four time scales. Performance varied widely (F1 scores of 0.46 to 0.84). With tuned settings and data pooled over longer periods, BirdNET came close to the experts (F1 0.84). It missed five of the 23 species that the experts found and found one species that the experts had missed. PLOS One published the study on 11 September 2025. The authors recorded at one urban site, and they recommend basic validation of BirdNET output.","category":"general benefit","unexpected":false,"purpose":"BirdNET was built to identify bird species in audio recordings. Species identification for monitoring is that purpose.","system":"BirdNET (BirdNET Analyzer)","model_version":null,"developer":"K. Lisa Yang Center for Conservation Bioacoustics, Cornell Lab of Ornithology, and Chemnitz University of Technology","deployer":"Technical University of Munich, Terrestrial Ecology Research Group","location":"Laim, Munich, Germany","domain":"Biodiversity monitoring","segment":null,"benefit_type":"Repetitive Task Automation","taxonomy_note":null,"registry_ids":{},"ratings":[{"group":"organizational","depth":1,"reason":"Researchers can obtain species lists close to expert lists (F1 0.84) without listening to every recording."}],"ai_role":{"status":"assessed","statement":"BirdNET and the experts worked on the same recordings, so the authors measure the agreement of the tool with expert identification directly."},"evidence":[{"kind":"peer-reviewed study","citation":"Fairbairn AJ, Burmeister JS, Weisser WW, Meyer ST. BirdNET can be as good as experts for acoustic bird monitoring in a European city. PLoS One. 2025;20(9):e0330836.","title":"BirdNET can be as good as experts for acoustic bird monitoring in a European city","url":"https://pmc.ncbi.nlm.nih.gov/articles/PMC12425287/","date":"2025-09-11","written_by":"evaluator","quote":"While BirdNET missed five species of the 23 species identified by the experts, our confirmation test revealed that BirdNET also found one species missed by the experts."}],"replication":{"produced_by":["The settings included week of year and location, with tuned overlap and confidence threshold.","Detections were pooled over longer periods before comparison."],"must_hold":["Users must tune settings and validate rare detections.","Local species must be well covered by BirdNET's training data."],"echoes":[{"date":"2023-08-15","setting":"Forest Science and Technology Center of Catalonia, AudioMoth recorders for two cryptic forest birds","model_version":null,"outcome":"recurred","source":"https://pmc.ncbi.nlm.nih.gov/articles/PMC10459908/"}]},"paired_incident":null,"headline":"A sound recognizer nearly matches bird experts on a Munich rooftop","metric":"BirdNET came close to the experts (F1 0.84)","comparator":{"against":"Two expert ornithologists annotating the same recordings","before":"Expert species list of 23 species","after":"BirdNET F1 score of 0.84 against the expert list, with one extra true species","basis":"measured","quote":"When given more data (higher temporal aggregation) and with tuned parameters, BirdNET came close to matching the expert identification (F1 score = 0.84).","url":"https://pmc.ncbi.nlm.nih.gov/articles/PMC12425287/"},"later":null,"value":null,"developer_country":"United States and Germany","deployer_country":"Germany","unrated_because":null,"brief_notes":null,"brief":null,"revisions":[{"date":"2026-10-29","change":"Added the case.","source":"https://pmc.ncbi.nlm.nih.gov/articles/PMC12425287/","editor":"AIBD"}],"confidence":"claimed","shade":"low","claim_status":"The evaluator's account","claim_basis":"Sources: the evaluators' peer-reviewed study. The cited evidence includes no independent source and no finding by a regulator or court.","case_jurisdictions":["Germany"],"profile":{"case_id":"AIBD-0662","catalog_version":"1.0.0","source_fingerprint":"1b746ad67b22c5f10027f6d0468d73106b05d8c14460c4171aa483c86afa315c","collection_refs":[{"collection_id":"aibd","version":"2026-10-29"}],"source_ids":["AIBD-0662-source-0001"],"families":{"strategic assessments":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"evaluations":{"state":"value_present","value":{"kind":"identifiers","identifiers":["AIBD-0662-evaluation-1"],"role":"Evaluations of the benefit"},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":[],"source_refs":["AIBD-0662-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"partial","record_ids":["AIBD-0662-evaluation-1"]},"monetary observations":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"institutional decisions":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]}},"fields":{"actors[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"developer":"K. Lisa Yang Center for Conservation Bioacoustics, Cornell Lab of Ornithology, and Chemnitz University of Technology","deployer":"Technical University of Munich, Terrestrial Ecology Research Group"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["developer","deployer"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"actors[].ownership_control":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"ai_contribution":{"state":"value_present","value":{"kind":"record_fields","fields":{"ai_role":{"status":"assessed","statement":"BirdNET and the experts worked on the same recordings, so the authors measure the agreement of the tool with expert identification directly."}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ai_role"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"ai_relationship":{"state":"value_present","value":{"kind":"record_fields","fields":{"category":"general benefit","ai_role":{"status":"assessed","statement":"BirdNET and the experts worked on the same recordings, so the authors measure the agreement of the tool with expert identification directly."}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ai_role","category"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].alternatives":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].assessor_date":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].depth":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"organizational","depth":1,"reason":"Researchers can obtain species lists close to expert lists (F1 0.84) without listening to every recording."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].display_confidence":{"state":"value_present","value":{"kind":"structured","data":{"confidence":"low","evidence_word":"claimed","claim_status":"The evaluator's account","basis":"Sources: the evaluators' peer-reviewed study. The cited evidence includes no independent source and no finding by a regulator or court.","interpretation":"Existing display rule preserved; the richer outcome-specific confidence question still needs review."}},"provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].rationale":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"organizational","depth":1,"reason":"Researchers can obtain species lists close to expert lists (F1 0.84) without listening to every recording."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].rubric_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].status_basis":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].target":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"organizational","depth":1,"reason":"Researchers can obtain species lists close to expert lists (F1 0.84) without listening to every recording."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"availability":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"brief":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"case_kind":{"state":"value_present","value":{"kind":"structured","data":{"classification":"evaluation or study","answer":"The case describes an evaluation or a study. Comparison of an AI tool with expert annotation.","scope":"The period and activity described in the case."}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["account","evidence"],"source_refs":["AIBD-0662-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"The case describes an evaluation or a study. Comparison of an AI tool with expert annotation.","inferred":false}},"case_links[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Compared with the incidents in the AI Incident Database snapshot of 26 October 2026.","record_fields":["paired_incident"],"source_refs":[]},"reason":"No incident in the AI Incident Database snapshot of 26 October 2026 concerns the same kind of system harming the same kind of stakeholder.","review_state":"reviewed","coverage":"partial"},"claims[].evidence_links":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].evidence_strength":{"state":"value_present","value":{"kind":"structured","data":{"answer":"The evaluator's account. Sources: the evaluators' peer-reviewed study. The cited evidence includes no independent source and no finding by a regulator or court.","evidence_word":"claimed","claim_status":"The evaluator's account"}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0662-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"The evaluator's account. Sources: the evaluators' peer-reviewed study. The cited evidence includes no independent source and no finding by a regulator or court.","inferred":false}},"claims[].missingness":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].proposition":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"cross_border_flows[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"decisions[].action_outcome":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].grounds":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].institution_task":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].success_criterion":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"deployment_stage":{"state":"value_present","value":{"kind":"structured","data":{"classification":"pilot","answer":"The system was used in a pilot. A research evaluation at one site.","scope":"The period and activity described in the case."}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["account","evidence"],"source_refs":["AIBD-0662-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"The system was used in a pilot. A research evaluation at one site.","inferred":false}},"economics[].amount":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].costs[]":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].counterfactual":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].currency_price_basis":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].gross_net":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].measure_type":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].period_unit":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].realization":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].recipient_payer":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].return_payback":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].valuation_method":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"evaluations[].ai_uplift":{"state":"value_present","value":{"kind":"text","text":"Near-expert species lists without manual listening."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0662-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Near-expert species lists without manual listening.","inferred":false}},"evaluations[].comparator":{"state":"value_present","value":{"kind":"text","text":"Expert identification of the same recordings."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0662-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Expert identification of the same recordings.","inferred":false}},"evaluations[].design":{"state":"value_present","value":{"kind":"text","text":"Controlled observational."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0662-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Controlled observational.","inferred":false}},"evaluations[].effect":{"state":"value_present","value":{"kind":"text","text":"F1 0.46 to 0.84 by setting; best 0.84."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0662-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"F1 0.46 to 0.84 by setting; best 0.84.","inferred":false}},"evaluations[].exposure":{"state":"value_present","value":{"kind":"text","text":"Research use."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0662-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Research use.","inferred":false}},"evaluations[].id":{"state":"value_present","value":{"kind":"identifiers","identifiers":["AIBD-0662-evaluation-1"],"role":"Evaluations of the benefit"},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0662-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Controlled observational.","inferred":false}},"evaluations[].measurement_method":{"state":"value_present","value":{"kind":"text","text":"Precision, recall and F1 of species lists against expert annotation; linear mixed models of setting effects."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0662-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Precision, recall and F1 of species lists against expert annotation; linear mixed models of setting effects.","inferred":false}},"evaluations[].metric":{"state":"value_present","value":{"kind":"text","text":"F1 score of species presence."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0662-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"F1 score of species presence.","inferred":false}},"evaluations[].reproduction_materials":{"state":"value_present","value":{"kind":"text","text":"Data on Dryad; code on GitHub."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0662-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Data on Dryad; code on GitHub.","inferred":false}},"evaluations[].setting_sample":{"state":"value_present","value":{"kind":"text","text":"15.5 hours of rooftop recordings over 60 days at one Munich site."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0662-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"15.5 hours of rooftop recordings over 60 days at one Munich site.","inferred":false}},"evaluations[].uncertainty_limitations":{"state":"value_present","value":{"kind":"text","text":"One site; short recording scheme; performance depends on settings."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0662-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"One site; short recording scheme; performance depends on settings.","inferred":false}},"external_references[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"follow_up[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"human_oversight":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"id":{"state":"value_present","value":{"kind":"record_fields","fields":{"id":"AIBD-0662"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["id"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"infrastructure_dependencies[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].beneficiaries":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].beneficiary_count":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].benefit_type":{"state":"value_present","value":{"kind":"record_fields","fields":{"benefit_type":"Repetitive Task Automation"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["benefit_type"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].claim":{"state":"value_present","value":{"kind":"record_fields","fields":{"account":"Researchers at the Technical University of Munich placed an acoustic recorder on the roof of a housing complex in Munich, Germany, and between June and October 2021 recorded one minute in every ten around sunrise over 60 days, for 15.5 hours of audio. Two experts identified every bird call. The team ran BirdNET, a deep-learning bird sound recognizer from the Cornell Lab of Ornithology and Chemnitz University of Technology, with 24 combinations of settings at four time scales. Performance varied widely (F1 scores of 0.46 to 0.84). With tuned settings and data pooled over longer periods, BirdNET came close to the experts (F1 0.84). It missed five of the 23 species that the experts found and found one species that the experts had missed. PLOS One published the study on 11 September 2025. The authors recorded at one urban site, and they recommend basic validation of BirdNET output.","benefit_type":"Repetitive Task Automation"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["account","benefit_type"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].distribution":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].duration":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].id":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].stakeholder_group":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"organizational","depth":1,"reason":"Researchers can obtain species lists close to expert lists (F1 0.84) without listening to every recording."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].status":{"state":"value_present","value":{"kind":"record_fields","fields":{"benefit_status":"reported"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["benefit_status"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].tradeoffs":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].unexpected":{"state":"value_present","value":{"kind":"record_fields","fields":{"unexpected":false,"purpose":"BirdNET was built to identify bird species in audio recordings. Species identification for monitoring is that purpose."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["unexpected","purpose"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"places[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"location":"Laim, Munich, Germany","developer_country":"United States and Germany","deployer_country":"Germany"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["location","developer_country","deployer_country"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"purpose":{"state":"value_present","value":{"kind":"record_fields","fields":{"purpose":"BirdNET was built to identify bird species in audio recordings. Species identification for monitoring is that purpose."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["purpose"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"record_dates":{"state":"value_present","value":{"kind":"record_fields","fields":{"date_observed":"2025-09-11","date_basis":"source publication","date_precision":"day","revisions":[{"date":"2026-10-29","change":"Added the case.","source":"https://pmc.ncbi.nlm.nih.gov/articles/PMC12425287/","editor":"AIBD"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["date_observed","date_basis","date_precision","revisions"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"replication.attempts[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"replication":{"produced_by":["The settings included week of year and location, with tuned overlap and confidence threshold.","Detections were pooled over longer periods before comparison."],"must_hold":["Users must tune settings and validate rare detections.","Local species must be well covered by BirdNET's training data."],"echoes":[{"date":"2023-08-15","setting":"Forest Science and Technology Center of Catalonia, AudioMoth recorders for two cryptic forest birds","outcome":"recurred","source":"https://pmc.ncbi.nlm.nih.gov/articles/PMC10459908/"}]}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["replication"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"replication.conditions":{"state":"value_present","value":{"kind":"record_fields","fields":{"replication":{"produced_by":["The settings included week of year and location, with tuned overlap and confidence threshold.","Detections were pooled over longer periods before comparison."],"must_hold":["Users must tune settings and validate rare detections.","Local species must be well covered by BirdNET's training data."],"echoes":[{"date":"2023-08-15","setting":"Forest Science and Technology Center of Catalonia, AudioMoth recorders for two cryptic forest birds","outcome":"recurred","source":"https://pmc.ncbi.nlm.nih.gov/articles/PMC10459908/"}]}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["replication"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"revision_history[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"revisions":[{"date":"2026-10-29","change":"Added the case.","source":"https://pmc.ncbi.nlm.nih.gov/articles/PMC12425287/","editor":"AIBD"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["revisions"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sector":{"state":"value_present","value":{"kind":"record_fields","fields":{"domain":"Biodiversity monitoring"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["domain"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].access_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"sources[].citation_locator":{"state":"value_present","value":{"kind":"record_fields","fields":{"evidence":[{"kind":"peer-reviewed study","citation":"Fairbairn AJ, Burmeister JS, Weisser WW, Meyer ST. BirdNET can be as good as experts for acoustic bird monitoring in a European city. PLoS One. 2025;20(9):e0330836.","title":"BirdNET can be as good as experts for acoustic bird monitoring in a European city","url":"https://pmc.ncbi.nlm.nih.gov/articles/PMC12425287/","date":"2025-09-11","written_by":"evaluator","quote":"While BirdNET missed five species of the 23 species identified by the experts, our confirmation test revealed that BirdNET also found one species missed by the experts."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].id":{"state":"value_present","value":{"kind":"identifiers","identifiers":["AIBD-0662-source-0001"],"role":"Existing evidence items, in their original order"},"provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"complete"},"sources[].language":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"sources[].relationship":{"state":"value_present","value":{"kind":"record_fields","fields":{"evidence":[{"kind":"peer-reviewed study","citation":"Fairbairn AJ, Burmeister JS, Weisser WW, Meyer ST. BirdNET can be as good as experts for acoustic bird monitoring in a European city. PLoS One. 2025;20(9):e0330836.","title":"BirdNET can be as good as experts for acoustic bird monitoring in a European city","url":"https://pmc.ncbi.nlm.nih.gov/articles/PMC12425287/","date":"2025-09-11","written_by":"evaluator","quote":"While BirdNET missed five species of the 23 species identified by the experts, our confirmation test revealed that BirdNET also found one species missed by the experts."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].upstream_sources":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"strategic_assessments[]":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"strategic assessments"},"summary":{"state":"value_present","value":{"kind":"record_fields","fields":{"summary":"TU Munich researchers compared BirdNET with two experts on 15.5 hours of rooftop recordings; with tuned settings BirdNET reached an F1 score of 0.84 and found one species the experts missed.","account":"Researchers at the Technical University of Munich placed an acoustic recorder on the roof of a housing complex in Munich, Germany, and between June and October 2021 recorded one minute in every ten around sunrise over 60 days, for 15.5 hours of audio. Two experts identified every bird call. The team ran BirdNET, a deep-learning bird sound recognizer from the Cornell Lab of Ornithology and Chemnitz University of Technology, with 24 combinations of settings at four time scales. Performance varied widely (F1 scores of 0.46 to 0.84). With tuned settings and data pooled over longer periods, BirdNET came close to the experts (F1 0.84). It missed five of the 23 species that the experts found and found one species that the experts had missed. PLOS One published the study on 11 September 2025. The authors recorded at one urban site, and they recommend basic validation of BirdNET output."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["summary","account"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"systems[].autonomy_permissions":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].component_role":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].deployment_configuration":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].inputs_outputs":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].model_name":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].model_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].product_name":{"state":"value_present","value":{"kind":"record_fields","fields":{"system":"BirdNET (BirdNET Analyzer)"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["system"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"systems[].provider":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"taxonomy_crosswalks[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"title":{"state":"value_present","value":{"kind":"record_fields","fields":{"title":"Independent Munich study finds that tuned BirdNET comes close to expert bird identification from city recordings","headline":"A sound recognizer nearly matches bird experts on a Munich rooftop"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["title","headline"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"version":{"state":"value_present","value":{"kind":"identifiers","identifiers":["e4e0d7de5f76b382320aeb5e46f82f76566e8db402927a0d0363b78987922b1f"],"role":"SHA-256 of the complete public case and its assessments"},"provenance":{"kind":"curatorial","basis":"SHA-256 of the public case, its assessments, and its displayed answers and notes, excluding its own identifier and the derived coverage summary.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"complete"},"workflow":{"state":"value_present","value":{"kind":"record_fields","fields":{"account":"Researchers at the Technical University of Munich placed an acoustic recorder on the roof of a housing complex in Munich, Germany, and between June and October 2021 recorded one minute in every ten around sunrise over 60 days, for 15.5 hours of audio. Two experts identified every bird call. The team ran BirdNET, a deep-learning bird sound recognizer from the Cornell Lab of Ornithology and Chemnitz University of Technology, with 24 combinations of settings at four time scales. Performance varied widely (F1 scores of 0.46 to 0.84). With tuned settings and data pooled over longer periods, BirdNET came close to the experts (F1 0.84). It missed five of the 23 species that the experts found and found one species that the experts had missed. PLOS One published the study on 11 September 2025. The authors recorded at one urban site, and they recommend basic validation of BirdNET output.","replication":{"produced_by":["The settings included week of year and location, with tuned overlap and confidence threshold.","Detections were pooled over longer periods before comparison."],"must_hold":["Users must tune settings and validate rare detections.","Local species must be well covered by BirdNET's training data."],"echoes":[{"date":"2023-08-15","setting":"Forest Science and Technology Center of Catalonia, AudioMoth recorders for two cryptic forest birds","outcome":"recurred","source":"https://pmc.ncbi.nlm.nih.gov/articles/PMC10459908/"}]}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["account","replication"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"}},"summary":{"total":91,"addressed":91,"known":42,"reviewed":15,"reviewed_complete":14,"reviewed_partial":1,"record_mapped":28,"review_not_assessed":48,"not_assessed":0,"complete":false,"by_state":{"value_present":42,"not_reported":0,"unresolved":49,"not_assessed":0,"not_applicable":0,"withheld":0,"source_unavailable":0}}},"presentation_version":"a23731bdba1b93640186a60f87fc3ea96c20f22a98a963f9ce7ef6e9a2e80a6c"}