Original scientific paper

THE ANALYSIS OF EXPERIMENTAL RESULTS OF MACHINE LEARNING APPROACH

Jaroslav E. Poliscuk ; Department of Electrical Engineering, University of Montenegro, Podgorica, Montenegro

Abstract

In this article is analyzed a reinforcement learning method, in which is defined a subject of learning. The essence of this method is the selection of activities by a try and fail process and awarding deferred rewards. If an environment is characterized by the Markov property, then step-by-step dynamics will enable forecasting of subsequent conditions and awarding subsequent rewards on the basis of the present known conditions and actions, relatively to the Markov decision making process. The relationship between the present conditions and values and the potential future conditions are defined by the Bellman equation. Also, the article discussed a method of temporal difference learning, mechanism of eligibility traces, as wel as theirs algorithms TD(0) and TD(Lambda). Theoretical analyses were supplemented by the practical studies, with reference to implementation of the Sarsa(Lambda) algorithm, with replacing eligibility traces and the Epsilon greedy policy.

Keywords

algorithm TD(0); algorithm TD(Lambda); Bellman equation; Markov decision making process; mechanism of eligibility traces; method of temporal difference learning; reinforcement learning method

Hrčak ID:

78379

URI

https://hrcak.srce.hr/78379

Publication date:

13.6.2003.

Visits: 980 *