-
公开(公告)号:US20230358429A1
公开(公告)日:2023-11-09
申请号:US17737427
申请日:2022-05-05
Applicant: Johnson Controls Tyco IP Holdings LLP
Inventor: Rajiv Ramanasankaran , Ambuj Shatdal , Michael James Risbeck , Young Lee
IPC: F24F11/63 , G05B19/042 , G06F11/30 , G06F11/34
CPC classification number: F24F11/63 , G05B19/042 , G06F11/3006 , G06F11/3409 , G05B2219/2614
Abstract: A building system including one or more memory devices storing instructions that, when executed by one or more processors, cause the one or more processors to store a plurality of digital twins, the plurality of digital twins comprising a virtual representation of a building, determine, based on the virtual representation of the building, that an operation of the first piece of building equipment is detectable by the second piece of building equipment. The instructions cause the one or more processors to execute a diagnostics routine comprising causing, by the first digital twin, the first piece of building equipment to perform the operation and receiving, by the second digital twin, one or more detections of the operation by the second piece of building equipment and generate a diagnostics report for the first piece of building equipment and the second piece of building equipment based on a result of the diagnostics routine.
-
公开(公告)号:US20230359189A1
公开(公告)日:2023-11-09
申请号:US17737436
申请日:2022-05-05
Applicant: Johnson Controls Tyco IP Holdings LLP
Inventor: Rajiv Ramanasankaran , Ambuj Shatdal , Michael James Risbeck , Young Lee
IPC: G05B23/02 , G06F16/901
CPC classification number: G05B23/0243 , G06F16/9024
Abstract: A building system operates to store a digital twin comprising a building graph, the building graph comprising a plurality of nodes representing a plurality of entities of a building and a plurality of edges between the plurality of nodes representing relationships between the plurality of entities. The instructions cause the one or more processors to determine a value for a functionality indicator for a piece of building equipment based on data received from the piece of building equipment, identify a first node of the plurality of nodes representing the functionality indicator by identifying an edge of the plurality of edges relating a second node of the plurality of nodes representing the piece of building equipment to the first node, and cause the first node to store the value for the functionality indicator, or a link to the value for the functionality indicator.
-
公开(公告)号:US20230359176A1
公开(公告)日:2023-11-09
申请号:US17737423
申请日:2022-05-05
Applicant: Johnson Controls Tyco IP Holdings LLP
Inventor: Rajiv Ramanasankaran , Ambuj Shatdal , Michael James Risbeck , Young Lee
IPC: G01R31/3185
CPC classification number: G01R31/318594 , G01R31/318552
Abstract: A building system including one or more memory devices storing instructions that, when executed by one or more processors cause the one or more processors to store a digital twin for a piece of building equipment, the digital twin comprising a virtual representation of the piece of building equipment, wherein the digital twin communicates with the piece of building equipment to operate the piece of building equipment and determine one or more diagnostic messages based on the virtual representation of the piece of building equipment and communicate the one or more diagnostic messages, by the digital twin, to the piece of building equipment causing the piece of building equipment to perform one or more operations. The instructions cause the one or more processors to receive one or more diagnostic message and generate a diagnostics report for the piece of building equipment based on the one or more diagnostic message responses.
-
4.
公开(公告)号:US11859847B2
公开(公告)日:2024-01-02
申请号:US17965345
申请日:2022-10-13
Applicant: Johnson Controls Tyco IP Holdings LLP
Inventor: Young M. Lee , Zhanhong Jiang , Viswanath Ramamurti , Sugumar Murugesan , Kirk H. Drees , Michael James Risbeck
CPC classification number: F24F11/64 , F24F11/47 , G05B13/027 , G05B13/04
Abstract: Systems and methods for training a reinforcement learning (RL) model for HVAC control are disclosed herein. Simulated experience data for the HVAC system is generated or received. The simulated experience data is used to initially train the RL model for HVAC control. The HVAC system operates within a building using the RL model and generates real experience data. A determination may be made to retrain the RL model. The real experience data is used to retrain the RL model. In some embodiments, both the simulated and real experience data are used to retrain the RL model. Experience data may be sampled according to various sampling functions. The RL model may be retrained multiple times over time. The RL model may be retrained less frequently over time as more real experience data is used to train the RL model.
-
公开(公告)号:US20230205158A1
公开(公告)日:2023-06-29
申请号:US18085375
申请日:2022-12-20
Applicant: Johnson Controls Tyco IP Holdings LLP
Inventor: Rajiv Ramanasankaran , Ambuj Shatdal , Michael James Risbeck , Chenlu Zhang , Krishnamurthy Selvaraj
IPC: G05B19/042 , G06F16/901 , G06F16/903 , G06N20/00
CPC classification number: G05B19/042 , G06F16/9024 , G06F16/90335 , G06N20/00 , G05B2219/25011
Abstract: A building system can operate to receive an indication from a user device of a user to query a digital twin of one or more buildings, the digital twin including entities including buildings, equipment, spaces, or data of the one or more buildings, the equipment, or the spaces, the digital twin including relationships between the entities. The building system can operate to receive building data from the digital twin by querying the digital twin based on the indication received from the user device. The building system can operate to generate an analytics model based on the building data, wherein the analytics model is trained based on the building data and deploy the analytics model to operate based on data of the one or more buildings and generate one or more analytic results based on the data of the one or more buildings.
-
公开(公告)号:US20230195066A1
公开(公告)日:2023-06-22
申请号:US18083387
申请日:2022-12-16
Applicant: Johnson Controls Tyco IP Holdings LLP
Inventor: Rajiv Ramanasankaran , Michael James Risbeck
IPC: G05B19/042
CPC classification number: G05B19/042 , G05B2219/25011
Abstract: A building system of a building operates to select an instance of one or more entities of one or more particular entity types from a digital twin of the building for creating a policy function, the digital twin including representations of entities of the building and relationships between the entities of the building. The building system operates to perform an optimization that selects one or more inputs of inputs associated with the one or more entities for input to the policy function, selects one or more actions of actions associated with the one or more entities that are outputs of the policy function, and identifies one or more parameters for the policy function. The building system operates to deploy the policy function for the one or more entities by causing the digital twin to include the policy function.
-
公开(公告)号:US11573540B2
公开(公告)日:2023-02-07
申请号:US16725999
申请日:2019-12-23
Applicant: Johnson Controls Tyco IP Holdings LLP
Inventor: Young M. Lee , Zhanhong Jiang , Viswanath Ramamurti , Sugumar Murugesan , Kirk H. Drees , Michael James Risbeck
Abstract: Systems and methods for training a reinforcement learning (RL) model for HVAC control are disclosed herein. A calibrated simulation model is used to train a surrogate model of the HVAC system operating within a building. The surrogate model is used to generate simulated experience data for the HVAC system. The simulated experience data can be used to train a reinforcement learning (RL) model of the HVAC system. The RL model is used to control the HVAC system based on the current state of the system and the best predicted action to perform in the current state. The HVAC system generates real experience data based on the actual operation of the HVAC system within the building. The real experience data is used to retrain the surrogate model, and additional simulated experience data is generated using the surrogate model. The RL model can be retrained using the additional simulated experience data.
-
8.
公开(公告)号:US20230034809A1
公开(公告)日:2023-02-02
申请号:US17965345
申请日:2022-10-13
Applicant: Johnson Controls Tyco IP Holdings LLP
Inventor: Young M. Lee , Zhanhong Jiang , Viswanath Ramamurti , Sugumar Murugesan , Kirk H. Drees , Michael James Risbeck
Abstract: Systems and methods for training a reinforcement learning (RL) model for HVAC control are disclosed herein. Simulated experience data for the HVAC system is generated or received. The simulated experience data is used to initially train the RL model for HVAC control. The HVAC system operates within a building using the RL model and generates real experience data. A determination may be made to retrain the RL model. The real experience data is used to retrain the RL model. In some embodiments, both the simulated and real experience data are used to retrain the RL model. Experience data may be sampled according to various sampling functions. The RL model may be retrained multiple times over time. The RL model may be retrained less frequently over time as more real experience data is used to train the RL model.
-
公开(公告)号:US11525596B2
公开(公告)日:2022-12-13
申请号:US16725961
申请日:2019-12-23
Applicant: Johnson Controls Tyco IP Holdings LLP
Inventor: Young M. Lee , Zhanhong Jiang , Viswanath Ramamurti , Sugumar Murugesan , Kirk H. Drees , Michael James Risbeck
Abstract: Systems and methods for training a reinforcement learning (RL) model for HVAC control are disclosed herein. Simulated experience data for the HVAC system is generated or received. The simulated experience data is used to initially train the RL model for HVAC control. The HVAC system operates within a building using the RL model and generates real experience data. A determination may be made to retrain the RL model. The real experience data is used to retrain the RL model. In some embodiments, both the simulated and real experience data are used to retrain the RL model. Experience data may be sampled according to various sampling functions. The RL model may be retrained multiple times over time. The RL model may be retrained less frequently over time as more real experience data is used to train the RL model.
-
-
-
-
-
-
-
-