Development of Digital Twin for Load Center on the Example of Distribution Network of an Urban District

The paper proposes a concept of building a digital twin based on the reinforcement learning method. This concept allows implementing an accurate digital model of an electrical network with bidirectional automatic data exchange, used for modeling, optimization, and control. The core of such a model is an agent (potential digital twin). The agent, while constantly interacting with a physical object (electrical grid), searches for an optimal strategy for active network management, which involves short-term strategies capable of controlling the power supplied by generators and/ or consumed by the load to avoid overload or voltage problems. Such an agent can verify its training with the initial default policy, which can be considered as a teacher’s advice. The effectiveness of this approach is demonstrated on a test 77-node scheme and a real 17-node network diagram of the Akademgorodok microdistrict (Irkutsk) according to the data from smart electricity meters.