Back to Search Start Over

Model-Based and Learning-Based Decision Making in Incomplete Information Cournot Games: A State Estimation Approach.

Authors :
Kebriaei, Hamed
Rahimi-Kian, Ashkan
Nili Ahmadabadi, Majid
Source :
IEEE Transactions on Systems, Man & Cybernetics. Systems; Apr2015, Vol. 45 Issue 4, p713-718, 6p
Publication Year :
2015

Abstract

In an incomplete information game, a big challenge is to find the best way of exploiting available information for optimal decision making of the agents. In this paper, two decision making methods, namely model-based and learning-based bidding strategies, are proposed and compared, for repeated Cournot competition of the generators in a day-ahead electricity market. The sum of the rivals’ offered quantities (SROQ) is considered as the state of the agent and its value is estimated using an adaptive expectation method. In the model-based approach, the convergence of the agents’ strategies to the Nash equilibrium point is also studied in two different cases. In the learning-based approach, the optimal bidding strategy is learned through combination of state estimation and a reinforcement learning method. Using the estimated state (SROQ), the optimal decision is learned through a fuzzy Q-learning algorithm. Through a case study, which is performed on the three-bus benchmark Cournot model, the convergence of the generators’ bids to the Nash-Cournot equilibrium is examined. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
21682216
Volume :
45
Issue :
4
Database :
Complementary Index
Journal :
IEEE Transactions on Systems, Man & Cybernetics. Systems
Publication Type :
Academic Journal
Accession number :
101601150
Full Text :
https://doi.org/10.1109/TSMC.2014.2373336