{"id":"AIBD-0911","title":"Pacific Northwest National Laboratory finds that SmartKit AI demand response alerts saved a GSA building $20,000 in 2022 while load alerts failed","summary":"PNNL found that demand response alerts from SmartKit AI cut a GSA building's capacity and transmission charges by $20,000 for 2022. Staff could not act on its load management alerts.","date_observed":"2022-01-01","date_basis":"event","date_precision":"year","benefit_status":"mixed","source_collection":null,"source_entry":null,"account":"The General Services Administration and the Department of Energy tested Logical Buildings' operator-in-the-loop software at 20 Washington Place in Newark, New Jersey. The evaluation ran from July 2021 through November 2022. The software sends alerts to building staff, who decide whether to act. Pacific Northwest National Laboratory reports that the vendor's machine learning drives its predictive alerts. In the summers of 2021 and 2022, the vendor called seven demand response events each year to cut the building's capacity and transmission charges. In 2022 its predictions matched the days that set those charges, and in 2021 they matched only some. PNNL estimated savings of $20,000 for 2022, a payback under one year. Staff could not act on 29 load management alerts within the required 15 minutes and switched them off. The vendor made no energy efficiency recommendations. The savings must still be confirmed on later bills. GSA and the Department of Energy funded the evaluation.","category":"benefit created","unexpected":false,"purpose":"Logical Buildings built SmartKit AI to monitor building loads and alert staff when to shed load for demand response and load management.","system":"SmartKit AI (operator-in-the-loop grid-interactive efficient building software)","model_version":null,"developer":"Logical Buildings","deployer":"U.S. General Services Administration, 20 Washington Place, Newark","location":"Newark, New Jersey, United States","domain":"Energy (building demand response)","segment":null,"benefit_type":"Reduced Task Cost","work_activities":["4.A.1.b.3","4.A.4.b.6"],"taxonomy_note":"The saving is in the building's capacity and transmission charges, which fall when staff shed load at the predicted hours.","registry_ids":{},"ratings":[{"group":"organizational","depth":1,"reason":"PNNL estimated that load shedding on the predicted days cut the building's capacity and transmission charges by $20,000 for 2022, a cost saving."}],"ai_role":{"status":"unassessed","statement":"PNNL computed the savings from the building's loads on the predicted days against its monthly peaks. It did not compare the vendor's predictions with another way of choosing the days, and staff shed the load themselves. PNNL writes that the vendor's machine learning enables the predictive alerts."},"evidence":[{"kind":"evaluation report","citation":"Myer, M. Operator-in-the-Loop Grid-Interactive Efficient Building Evaluation. Pacific Northwest National Laboratory for the U.S. General Services Administration and the U.S. Department of Energy, GSA Proving Ground report GPG-055, April 2025.","title":"Operator-in-the-Loop Grid-Interactive Efficient Building Evaluation","url":"https://www.gsa.gov/system/files/GPG055-Operator%20in%20the%20Loop-508Compliant_Final%20Report.pdf","date":"2025-04-01","written_by":"evaluator","quote":"These ICAP-related events resulted in $20,000 in savings for 2022."},{"kind":"evaluation report","citation":"Myer, M. Operator-in-the-Loop Grid-Interactive Efficient Building Evaluation. Pacific Northwest National Laboratory, GPG-055, April 2025. Executive summary.","title":"Operator-in-the-Loop Grid-Interactive Efficient Building Evaluation","url":"https://www.gsa.gov/system/files/GPG055-Operator%20in%20the%20Loop-508Compliant_Final%20Report.pdf","date":"2025-04-01","written_by":"evaluator","quote":"Load management was not successful for the operator-in-the-loop option.","supports_benefit":false}],"replication":{"produced_by":["The vendor metered the chillers and the utility meter and sent the data to its cloud.","Staff received notice the day before and the morning of each demand response event.","Staff shed load during the predicted hours."],"must_hold":["Staff get notice early enough to act, since alerts needing a 15-minute response went unanswered.","The predicted hours coincide with the hours that the grid operator and the utility use to set the charges."],"echoes":[]},"paired_incident":null,"headline":"*SmartKit AI* alerts cut a Newark federal building's capacity charges","metric":"$20,000 for 2022","comparator":{"against":"The building's average monthly maximum load from June to September 2022","before":"449 kW [maximum]","after":"334 kW [average during ICAP events]","basis":"measured","quote":"The 2022 PJM ICAP savings are 115 kW (449 kW [maximum] - 334 kW [average during ICAP events]) x $5.701 / kW (capacity charges) x 12 months (reduced capacity charges each month) = $7,847.","url":"https://www.gsa.gov/system/files/GPG055-Operator%20in%20the%20Loop-508Compliant_Final%20Report.pdf"},"later":null,"value":{"amount":"$20,000","what":"Savings in capacity and transmission (ICAP) charges for 2022 from demand response on the predicted days","who":"U.S. General Services Administration","estimate":true,"quote":"These ICAP-related events resulted in $20,000 in savings for 2022.","url":"https://www.gsa.gov/system/files/GPG055-Operator%20in%20the%20Loop-508Compliant_Final%20Report.pdf"},"developer_country":"United States","deployer_country":"United States","unrated_because":null,"brief_notes":null,"brief":null,"revisions":[{"date":"2026-10-31","change":"Added the record from the report of Pacific Northwest National Laboratory.","source":"https://www.gsa.gov/system/files/GPG055-Operator%20in%20the%20Loop-508Compliant_Final%20Report.pdf","editor":"AIBD"}],"confidence":"claimed","shade":"low","claim_status":"The evaluator's account","claim_basis":"Sources: the evaluators' evaluation report. For the benefit itself, the cited sources include no independent source and no finding by an external body.","case_jurisdictions":["United States"],"profile":{"case_id":"AIBD-0911","catalog_version":"1.0.0","source_fingerprint":"a027a5d9c75adb6f75ba28dd9084978230eaa6bb44f2cec4930d3410c605b531","collection_refs":[{"collection_id":"aibd","version":"2026-10-31"},{"collection_id":"querist","version":"2026-10-25"}],"source_ids":["AIBD-0911-source-0001","AIBD-0911-source-0002"],"families":{"strategic assessments":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"evaluations":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"monetary observations":{"state":"value_present","value":{"kind":"text","text":"An existing source-stated monetary observation is present in the original value object."},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["value"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial","record_ids":["AIBD-0911-legacy-value"]},"institutional decisions":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]}},"fields":{"actors[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"developer":"Logical Buildings","deployer":"U.S. General Services Administration, 20 Washington Place, Newark"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["developer","deployer"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"actors[].ownership_control":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"ai_contribution":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"ai_relationship":{"state":"value_present","value":{"kind":"record_fields","fields":{"category":"benefit created","ai_role":{"status":"unassessed","statement":"PNNL computed the savings from the building's loads on the predicted days against its monthly peaks. It did not compare the vendor's predictions with another way of choosing the days, and staff shed the load themselves. PNNL writes that the vendor's machine learning enables the predictive alerts."}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ai_role","category"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].alternatives":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].assessor_date":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].depth":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"organizational","depth":1,"reason":"PNNL estimated that load shedding on the predicted days cut the building's capacity and transmission charges by $20,000 for 2022, a cost saving."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].display_confidence":{"state":"value_present","value":{"kind":"structured","data":{"confidence":"low","evidence_word":"claimed","claim_status":"The evaluator's account","basis":"Sources: the evaluators' evaluation report. For the benefit itself, the cited sources include no independent source and no finding by an external body.","interpretation":"Existing display rule preserved; the richer outcome-specific confidence question still needs review."}},"provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].rationale":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"organizational","depth":1,"reason":"PNNL estimated that load shedding on the predicted days cut the building's capacity and transmission charges by $20,000 for 2022, a cost saving."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].rubric_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].status_basis":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].target":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"organizational","depth":1,"reason":"PNNL estimated that load shedding on the predicted days cut the building's capacity and transmission charges by $20,000 for 2022, a cost saving."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"availability":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"brief":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"case_kind":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"case_links[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].evidence_links":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].evidence_strength":{"state":"value_present","value":{"kind":"structured","data":{"answer":"The evaluator's account. Sources: the evaluators' evaluation report. For the benefit itself, the cited sources include no independent source and no finding by an external body.","evidence_word":"claimed","claim_status":"The evaluator's account"}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0911-source-0001","AIBD-0911-source-0002"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"The evaluator's account. Sources: the evaluators' evaluation report. For the benefit itself, the cited sources include no independent source and no finding by an external body.","inferred":false}},"claims[].missingness":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].proposition":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"cross_border_flows[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"decisions[].action_outcome":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].grounds":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].institution_task":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].success_criterion":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"deployment_stage":{"state":"value_present","value":{"kind":"structured","data":{"classification":"pilot","answer":"The system was used in a pilot. GSA evaluated the software at one building from July 2021 through November 2022.","scope":"The period and activity described in the case."}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["account","evidence"],"source_refs":["AIBD-0911-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"The system was used in a pilot. GSA evaluated the software at one building from July 2021 through November 2022.","inferred":false}},"economics[].amount":{"state":"value_present","value":{"kind":"record_fields","fields":{"value":{"amount":"$20,000","what":"Savings in capacity and transmission (ICAP) charges for 2022 from demand response on the predicted days","who":"U.S. General Services Administration","estimate":true,"quote":"These ICAP-related events resulted in $20,000 in savings for 2022.","url":"https://www.gsa.gov/system/files/GPG055-Operator%20in%20the%20Loop-508Compliant_Final%20Report.pdf"}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["value"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"economics[].costs[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"economics[].counterfactual":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"economics[].currency_price_basis":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"economics[].gross_net":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"economics[].measure_type":{"state":"value_present","value":{"kind":"record_fields","fields":{"value":{"amount":"$20,000","what":"Savings in capacity and transmission (ICAP) charges for 2022 from demand response on the predicted days","who":"U.S. General Services Administration","estimate":true,"quote":"These ICAP-related events resulted in $20,000 in savings for 2022.","url":"https://www.gsa.gov/system/files/GPG055-Operator%20in%20the%20Loop-508Compliant_Final%20Report.pdf"}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["value"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"economics[].period_unit":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"economics[].realization":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"economics[].recipient_payer":{"state":"value_present","value":{"kind":"record_fields","fields":{"value":{"amount":"$20,000","what":"Savings in capacity and transmission (ICAP) charges for 2022 from demand response on the predicted days","who":"U.S. General Services Administration","estimate":true,"quote":"These ICAP-related events resulted in $20,000 in savings for 2022.","url":"https://www.gsa.gov/system/files/GPG055-Operator%20in%20the%20Loop-508Compliant_Final%20Report.pdf"}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["value"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"economics[].return_payback":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"economics[].valuation_method":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"evaluations[].ai_uplift":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].comparator":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].design":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].effect":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].exposure":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].id":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].measurement_method":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].metric":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].reproduction_materials":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].setting_sample":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].uncertainty_limitations":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"external_references[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"follow_up[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"human_oversight":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"id":{"state":"value_present","value":{"kind":"record_fields","fields":{"id":"AIBD-0911"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["id"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"infrastructure_dependencies[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].beneficiaries":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].beneficiary_count":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].benefit_type":{"state":"value_present","value":{"kind":"record_fields","fields":{"benefit_type":"Reduced Task Cost","taxonomy_note":"The saving is in the building's capacity and transmission charges, which fall when staff shed load at the predicted hours."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["benefit_type","taxonomy_note"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].claim":{"state":"value_present","value":{"kind":"record_fields","fields":{"account":"The General Services Administration and the Department of Energy tested Logical Buildings' operator-in-the-loop software at 20 Washington Place in Newark, New Jersey. The evaluation ran from July 2021 through November 2022. The software sends alerts to building staff, who decide whether to act. Pacific Northwest National Laboratory reports that the vendor's machine learning drives its predictive alerts. In the summers of 2021 and 2022, the vendor called seven demand response events each year to cut the building's capacity and transmission charges. In 2022 its predictions matched the days that set those charges, and in 2021 they matched only some. PNNL estimated savings of $20,000 for 2022, a payback under one year. Staff could not act on 29 load management alerts within the required 15 minutes and switched them off. The vendor made no energy efficiency recommendations. The savings must still be confirmed on later bills. GSA and the Department of Energy funded the evaluation.","benefit_type":"Reduced Task Cost"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["account","benefit_type"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].distribution":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].duration":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].id":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].stakeholder_group":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"organizational","depth":1,"reason":"PNNL estimated that load shedding on the predicted days cut the building's capacity and transmission charges by $20,000 for 2022, a cost saving."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].status":{"state":"value_present","value":{"kind":"record_fields","fields":{"benefit_status":"mixed"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["benefit_status"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].tradeoffs":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].unexpected":{"state":"value_present","value":{"kind":"record_fields","fields":{"unexpected":false,"purpose":"Logical Buildings built SmartKit AI to monitor building loads and alert staff when to shed load for demand response and load management."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["unexpected","purpose"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"places[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"location":"Newark, New Jersey, United States","developer_country":"United States","deployer_country":"United States"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["location","developer_country","deployer_country"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"purpose":{"state":"value_present","value":{"kind":"record_fields","fields":{"purpose":"Logical Buildings built SmartKit AI to monitor building loads and alert staff when to shed load for demand response and load management."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["purpose"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"record_dates":{"state":"value_present","value":{"kind":"record_fields","fields":{"date_observed":"2022-01-01","date_basis":"event","date_precision":"year","revisions":[{"date":"2026-10-31","change":"Added the record from the report of Pacific Northwest National Laboratory.","source":"https://www.gsa.gov/system/files/GPG055-Operator%20in%20the%20Loop-508Compliant_Final%20Report.pdf","editor":"AIBD"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["date_observed","date_basis","date_precision","revisions"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"replication.attempts[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"replication.conditions":{"state":"value_present","value":{"kind":"record_fields","fields":{"replication":{"produced_by":["The vendor metered the chillers and the utility meter and sent the data to its cloud.","Staff received notice the day before and the morning of each demand response event.","Staff shed load during the predicted hours."],"must_hold":["Staff get notice early enough to act, since alerts needing a 15-minute response went unanswered.","The predicted hours coincide with the hours that the grid operator and the utility use to set the charges."],"echoes":[]}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["replication"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"revision_history[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"revisions":[{"date":"2026-10-31","change":"Added the record from the report of Pacific Northwest National Laboratory.","source":"https://www.gsa.gov/system/files/GPG055-Operator%20in%20the%20Loop-508Compliant_Final%20Report.pdf","editor":"AIBD"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["revisions"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sector":{"state":"value_present","value":{"kind":"record_fields","fields":{"domain":"Energy (building demand response)"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["domain"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].access_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"sources[].citation_locator":{"state":"value_present","value":{"kind":"record_fields","fields":{"evidence":[{"kind":"evaluation report","citation":"Myer, M. Operator-in-the-Loop Grid-Interactive Efficient Building Evaluation. Pacific Northwest National Laboratory for the U.S. General Services Administration and the U.S. Department of Energy, GSA Proving Ground report GPG-055, April 2025.","title":"Operator-in-the-Loop Grid-Interactive Efficient Building Evaluation","url":"https://www.gsa.gov/system/files/GPG055-Operator%20in%20the%20Loop-508Compliant_Final%20Report.pdf","date":"2025-04-01","written_by":"evaluator","quote":"These ICAP-related events resulted in $20,000 in savings for 2022."},{"kind":"evaluation report","citation":"Myer, M. Operator-in-the-Loop Grid-Interactive Efficient Building Evaluation. Pacific Northwest National Laboratory, GPG-055, April 2025. Executive summary.","title":"Operator-in-the-Loop Grid-Interactive Efficient Building Evaluation","url":"https://www.gsa.gov/system/files/GPG055-Operator%20in%20the%20Loop-508Compliant_Final%20Report.pdf","date":"2025-04-01","written_by":"evaluator","quote":"Load management was not successful for the operator-in-the-loop option.","supports_benefit":false}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].id":{"state":"value_present","value":{"kind":"identifiers","identifiers":["AIBD-0911-source-0001","AIBD-0911-source-0002"],"role":"Existing evidence items, in their original order"},"provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"complete"},"sources[].language":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"sources[].relationship":{"state":"value_present","value":{"kind":"record_fields","fields":{"evidence":[{"kind":"evaluation report","citation":"Myer, M. Operator-in-the-Loop Grid-Interactive Efficient Building Evaluation. Pacific Northwest National Laboratory for the U.S. General Services Administration and the U.S. Department of Energy, GSA Proving Ground report GPG-055, April 2025.","title":"Operator-in-the-Loop Grid-Interactive Efficient Building Evaluation","url":"https://www.gsa.gov/system/files/GPG055-Operator%20in%20the%20Loop-508Compliant_Final%20Report.pdf","date":"2025-04-01","written_by":"evaluator","quote":"These ICAP-related events resulted in $20,000 in savings for 2022."},{"kind":"evaluation report","citation":"Myer, M. Operator-in-the-Loop Grid-Interactive Efficient Building Evaluation. Pacific Northwest National Laboratory, GPG-055, April 2025. Executive summary.","title":"Operator-in-the-Loop Grid-Interactive Efficient Building Evaluation","url":"https://www.gsa.gov/system/files/GPG055-Operator%20in%20the%20Loop-508Compliant_Final%20Report.pdf","date":"2025-04-01","written_by":"evaluator","quote":"Load management was not successful for the operator-in-the-loop option.","supports_benefit":false}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].upstream_sources":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"strategic_assessments[]":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"strategic assessments"},"summary":{"state":"value_present","value":{"kind":"record_fields","fields":{"summary":"PNNL found that demand response alerts from SmartKit AI cut a GSA building's capacity and transmission charges by $20,000 for 2022. Staff could not act on its load management alerts.","account":"The General Services Administration and the Department of Energy tested Logical Buildings' operator-in-the-loop software at 20 Washington Place in Newark, New Jersey. The evaluation ran from July 2021 through November 2022. The software sends alerts to building staff, who decide whether to act. Pacific Northwest National Laboratory reports that the vendor's machine learning drives its predictive alerts. In the summers of 2021 and 2022, the vendor called seven demand response events each year to cut the building's capacity and transmission charges. In 2022 its predictions matched the days that set those charges, and in 2021 they matched only some. PNNL estimated savings of $20,000 for 2022, a payback under one year. Staff could not act on 29 load management alerts within the required 15 minutes and switched them off. The vendor made no energy efficiency recommendations. The savings must still be confirmed on later bills. GSA and the Department of Energy funded the evaluation."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["summary","account"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"systems[].autonomy_permissions":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].component_role":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].deployment_configuration":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].inputs_outputs":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].model_name":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].model_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].product_name":{"state":"value_present","value":{"kind":"record_fields","fields":{"system":"SmartKit AI (operator-in-the-loop grid-interactive efficient building software)"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["system"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"systems[].provider":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"taxonomy_crosswalks[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"title":{"state":"value_present","value":{"kind":"record_fields","fields":{"title":"Pacific Northwest National Laboratory finds that SmartKit AI demand response alerts saved a GSA building $20,000 in 2022 while load alerts failed","headline":"*SmartKit AI* alerts cut a Newark federal building's capacity charges"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["title","headline"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"version":{"state":"value_present","value":{"kind":"identifiers","identifiers":["46280b7f35cc8597bd4803c1d050d71b9b97775b71624943d0b4a422da1edd50"],"role":"SHA-256 of the complete public record and its assessments"},"provenance":{"kind":"curatorial","basis":"SHA-256 of the public record, its assessments, and its displayed answers and notes, excluding its own identifier and the derived coverage summary.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"complete"},"workflow":{"state":"value_present","value":{"kind":"record_fields","fields":{"account":"The General Services Administration and the Department of Energy tested Logical Buildings' operator-in-the-loop software at 20 Washington Place in Newark, New Jersey. The evaluation ran from July 2021 through November 2022. The software sends alerts to building staff, who decide whether to act. Pacific Northwest National Laboratory reports that the vendor's machine learning drives its predictive alerts. In the summers of 2021 and 2022, the vendor called seven demand response events each year to cut the building's capacity and transmission charges. In 2022 its predictions matched the days that set those charges, and in 2021 they matched only some. PNNL estimated savings of $20,000 for 2022, a payback under one year. Staff could not act on 29 load management alerts within the required 15 minutes and switched them off. The vendor made no energy efficiency recommendations. The savings must still be confirmed on later bills. GSA and the Department of Energy funded the evaluation.","replication":{"produced_by":["The vendor metered the chillers and the utility meter and sent the data to its cloud.","Staff received notice the day before and the morning of each demand response event.","Staff shed load during the predicted hours."],"must_hold":["Staff get notice early enough to act, since alerts needing a 15-minute response went unanswered.","The predicted hours coincide with the hours that the grid operator and the utility use to set the charges."],"echoes":[]}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["account","replication"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"}},"summary":{"total":91,"addressed":91,"known":31,"reviewed":2,"reviewed_complete":2,"reviewed_partial":0,"record_mapped":29,"review_not_assessed":60,"not_assessed":0,"complete":false,"by_state":{"value_present":31,"not_reported":0,"unresolved":60,"not_assessed":0,"not_applicable":0,"withheld":0,"source_unavailable":0}}},"presentation_version":"b99c3d8f6a006e12ff263ac6150ab102c2ae22a22f96ab10f21f00ce159d15d1"}