A sound recognizer nearly matches bird experts on a Munich rooftop

TU Munich researchers compared BirdNET with two experts on 15.5 hours of rooftop recordings; with tuned settings BirdNET reached an F1 score of 0.84 and found one species the experts missed.

1
Benefit status
Reported
Evidence
Claimed by the parties
Source published
Sources
1 publication
Download data CiteSuggest a correction

Benefits

Benefit

BirdNET came close to the experts (F1 0.84)

Awaiting review

Outcome identifiers

Unresolved

Not reviewedUnresolved

Category

Repetitive Task Automation

Awaiting review

Status

Reported benefit

Awaiting review

Beneficiary groups

Organizations.

Awaiting review

Beneficiaries

Unresolved

Not reviewedUnresolved

Reach

Unresolved

Not reviewedUnresolved

Distribution and access

Unresolved

Not reviewedUnresolved

Duration

Unresolved

Not reviewedUnresolved

Expected?

Yes

Awaiting review

Costs and harms

Unresolved

Not reviewedUnresolved

AI system

System

BirdNET (BirdNET Analyzer)

Awaiting review

Model

This is an explicit unresolved assignment: the sources on record do not settle this question.

Not reviewedUnresolved

Release

Unresolved

Not reviewedUnresolved

Provider

Unresolved

Not reviewedUnresolved

Role

Unresolved

Not reviewedUnresolved

Configuration

Unresolved

Not reviewedUnresolved

Inputs and outputs

Unresolved

Not reviewedUnresolved

Autonomy

Unresolved

Not reviewedUnresolved

Workflow

The settings included week of year and location, with tuned overlap and confidence threshold. Detections were pooled over longer periods before comparison.

Awaiting review

Human oversight

Unresolved

Not reviewedUnresolved

Relation to AI

BirdNET and the experts worked on the same recordings, so the authors measure the agreement of the tool with expert identification directly.

Awaiting review

AI contribution

BirdNET and the experts worked on the same recordings, so the authors measure the agreement of the tool with expert identification directly.

Awaiting review

Measurement

Studies

Controlled observational. [1]

Fully reviewed

Review date: 29 October 2026.

Sources: [1]

Study design

Controlled observational. [1]

Fully reviewed

Review date: 29 October 2026.

Sources: [1]

Measurement

Precision, recall and F1 of species lists against expert annotation; linear mixed models of setting effects. [1]

Fully reviewed

Review date: 29 October 2026.

Sources: [1]

Setting and sample

15.5 hours of rooftop recordings over 60 days at one Munich site. [1]

Fully reviewed

Review date: 29 October 2026.

Sources: [1]

Measures

F1 score of species presence. [1]

Fully reviewed

Review date: 29 October 2026.

Sources: [1]

Comparison

Expert identification of the same recordings. [1]

Fully reviewed

Review date: 29 October 2026.

Sources: [1]

Results

F1 0.46 to 0.84 by setting; best 0.84. [1]

Fully reviewed

Review date: 29 October 2026.

Sources: [1]

Additional value from AI

Near-expert species lists without manual listening. [1]

Fully reviewed

Review date: 29 October 2026.

Sources: [1]

Limitations

One site; short recording scheme; performance depends on settings. [1]

Fully reviewed

Review date: 29 October 2026.

Sources: [1]

Denominators

Research use. [1]

Fully reviewed

Review date: 29 October 2026.

Sources: [1]

Materials for replication

Data on Dryad; code on GitHub. [1]

Fully reviewed

Review date: 29 October 2026.

Sources: [1]

Money

Kind of value

The kind of monetary value is unclear.

Not reviewedUnresolved

Amount

The monetary value is not established.

Not reviewedUnresolved

Currency and prices

The currency and price basis are unclear.

Not reviewedUnresolved

Period and unit

The period and unit of the monetary estimate are unclear.

Not reviewedUnresolved

Realization

Whether the monetary value was realized is unclear.

Not reviewedUnresolved

Recipients and payers

The recipients and payers are unclear.

Not reviewedUnresolved

Gross or net

Whether the monetary figure includes costs is unclear.

Not reviewedUnresolved

Included costs

The costs included in the estimate are unclear.

Not reviewedUnresolved

Comparison

The financial comparison is not established.

Not reviewedUnresolved

Method

The method used to calculate monetary value is unclear.

Not reviewedUnresolved

Return and payback

The return on investment or payback period is not established.

Not reviewedUnresolved

People and places

Participants

Developer: K. Lisa Yang Center for Conservation Bioacoustics, Cornell Lab of Ornithology, and Chemnitz University of Technology. Operator: Technical University of Munich, Terrestrial Ecology Research Group.

Awaiting review

Jurisdictions

Benefit: Laim, Munich, Germany. Developer: United States and Germany. Operator: Germany.

Awaiting review

Ownership and control

Unresolved

Not reviewedUnresolved

Dependencies

Unresolved

Not reviewedUnresolved

Cross-border connections

Unresolved

Not reviewedUnresolved

Geopolitical implications

The geopolitical implications are unclear.

Not reviewedUnresolved

Follow-up

Conditions for replication

Users must tune settings and validate rare detections. Local species must be well covered by BirdNET's training data.

Awaiting review

Replication attempts

1 follow-up entry. Benefit recurred: 1.

Awaiting review

Later findings

Unresolved

Not reviewedUnresolved

Availability

Unresolved

Not reviewedUnresolved

Institutional decision

A relevant institutional decision has not been established.

Not reviewedUnresolved

Grounds

The grounds for an institutional decision are unclear.

Not reviewedUnresolved

Action and result

The result of an institutional decision is not established.

Not reviewedUnresolved

Success criterion

The criterion for a successful institutional decision is unclear.

Not reviewedUnresolved

Evidence

Source numbers

AIBD-0662-source-0001

Awaiting review

Citations

Numbered references below.

Awaiting review

Language

Unresolved

Not reviewedUnresolved

Source relationships

Evaluator

Awaiting review

Original evidence

Unresolved

Not reviewedUnresolved

Access and versions

Unresolved

Not reviewedUnresolved

Supported findings

Unresolved

Not reviewedUnresolved

Evidence strength

The evaluator's account. Sources: the evaluators' peer-reviewed study. The cited evidence includes no independent source and no finding by a regulator or court. [1]

Fully reviewed

Review date: 29 October 2026.

Sources: [1]

Missing evidence

Unresolved

Not reviewedUnresolved

Grades

Assessed benefits

Organizations.

Awaiting review

Depth

Organizations: 1.

Awaiting review

Reasons

Organizations: Researchers can obtain species lists close to expert lists (F1 0.84) without listening to every recording.

Awaiting review

Observed or intended

Unresolved

Not reviewedUnresolved

Rubric

Unresolved

Not reviewedUnresolved

Assessor and date

Unresolved

Not reviewedUnresolved

Alternative assessments

Unresolved

Not reviewedUnresolved

Fill

The evaluator's account

Awaiting review

Entry details

Kind

The case describes an evaluation or a study. Comparison of an AI tool with expert annotation. [1]

Fully reviewed

Review date: 29 October 2026.

Sources: [1]

Field

Biodiversity monitoring.

Awaiting review

Purpose

BirdNET was built to identify bird species in audio recordings. Species identification for monitoring is that purpose.

Awaiting review

Dates

Source published: 11 September 2025. Updated: 29 October 2026.

Awaiting review

Stage

The system was used in a pilot. A research evaluation at one site. [1]

Fully reviewed

Review date: 29 October 2026.

Sources: [1]

Version

SHA-256: e4e0d7de5f76…

Awaiting review

SHA-256 of the public case, its assessments, and its displayed answers and notes, excluding its own identifier and the derived coverage summary.

References

Other identifiers

Unresolved

Not reviewedUnresolved

Category mappings

Unresolved

Not reviewedUnresolved

Citable summary

Unresolved

Not reviewedUnresolved

Revisions

1 revision. Latest: 29 October 2026.

Awaiting review

Sources

  1. Peer-reviewed study Evaluator

    Fairbairn AJ, Burmeister JS, Weisser WW, Meyer ST. BirdNET can be as good as experts for acoustic bird monitoring in a European city. PLoS One. 2025;20(9):e0330836.

Cite this case

BibTeX Download BibTeX

Version e4e0d7de5f76, archived in the edition of 29 October 2026

Benefit marks

Depth

The number and color show the depth of a benefit.

  1. A convenience, or time or money saved.
  2. A measurable improvement in a result or ability.
  3. A lasting change, an ability restored, or a risk removed.
  4. A serious harm averted or a serious condition resolved in time.
  5. A life or livelihood preserved, or a change documented across a population.

Beneficiary

  • Circle: a person
  • Square: an organization
  • Triangle: society

Evidence

  • Solid. A court or regulator found a benefit, or researchers independently studied it.

  • Hatched. Independent reporting.

  • Outline. Claimed by the parties. Only the people or organizations involved, or sources whose independence has not been assessed, support the benefit.

The fill changes with the evidence. The depth color stays the same.

How benefits are assessed