Volume 12, Number 1 (March 2016)                   IJEEE 2016, 12(1): 42-51 | Back to browse issues page



DOI: 10.22068/IJEEE.12.1.42

XML Print


Download citation:
BibTeX | RIS | EndNote | Medlars | ProCite | Reference Manager | RefWorks
Send citation to:

Bakhshandeh H, Akbari Foroud A. Development of Reinforcement Learning Algorithm to Study the Capacity Withholding in Electricity Energy Markets. IJEEE. 2016; 12 (1) :42-51
URL: http://ijeee.iust.ac.ir/article-1-810-en.html

Abstract:   (1373 Views)

This paper addresses the possibility of capacity withholding by energy producers, who seek to increase the market price and their own profits. The energy market is simulated as an iterative game, where each state game corresponds to an hourly energy auction with uniform pricing mechanism. The producers are modeled as agents that interact with their environment through reinforcement learning (RL) algorithm. Each producer submits step-wise offer curves, which include the quantity-price pairs, to independent system operator (ISO) under incomplete information. An experimental change is employed in the producer's profit maximization model that causes the iterative algorithm converge to a withholding bidding value. The producer can withhold the energy of his own generating unit in a continuous range of its available capacity. The RL relation is developed to prevent from becoming invalid in certain situations. The results on a small test system demonstrate the emergence of the capacity withholding by the producers and its effect on the market price.

Full-Text [PDF 399 kb]   (640 Downloads)    
Type of Study: Research Paper | Subject: Market Deregulation
Received: 2015/07/02 | Accepted: 2016/03/09 | Published: 2016/03/14

Add your comments about this article : Your username or email:
Write the security code in the box