Can a super-capacitor energy storage system be based on deep reinforcement learning?

Paper suggests an energy management strategy for a super-capacitor energy storage system in an urban rail transit, which is based on deep reinforcement learning. The management system is modeled as an agent that iteratively improves its behavior, and finally converges to a nearly-optimal policy.

What are the applications of energy storage systems?

Energy storage systems are essential to the operation of electrical energy systems. They ensure continuity of energy supply and improve the reliability of the system by providing excellent energy management techniques. The potential applications of energy storage systems include utility, commercial and industrial, off-grid and micro-grid systems.

What is energy storage in Electrical Engineering?

This special issue of Electrical Engineering—Archiv fur Elektrotechnik, covers energy storage systems and applications, including the various methods of energy storage and their incorporation into and integration with both conventional and renewable energy systems. Energy storage systems are essential to the operation of electrical energy systems.

How does a storage controller work?

At each step of the interaction the controller receives an input that indicates the current state of the storage system. The controller then chooses an action, which affects the next state of the storage system, and the value of this new state is communicated to the controller through a scalar signal.

Can dynamic programming solve energy storage optimization problems?

Due to various advantages, dynamic programming based algorithms are used extensively for solving energy storage optimization problems. Several studies use dynamic programming to control storage in residential energy systems, with the goal of lowering the cost of electricity , , .

Can dynamic programming improve regenerative braking performance in ultra-capacitor energy storage systems?

Numeric experiments reveal that for lossless storage devices dynamic programming is beneficial, however for lossy storage devices the minimum principle provides faster and more accurate solutions. Work studies the optimal charging profile of an ultra-capacitor energy storage system during a regenerative braking event.