Reinforcement Leaning of Fuzzy Control Rules with Context-Specitic Segmentation of Actions

Abstract

Knowledge acquisition mainly involves two approaches: deriving general or abstract rules from human expertise such as heuristics of target systems, refined properly using further information, and extracting proper rules from experimental information, i.e., information on rewards and penalties obtained from all the possible alternative rules initially prepared ‐ our approach. Reinforcement learning methods are applied to problems where meaningful I/O sets cannot be specified beforehand. There are, however few algorithms to extract heuristics for action selection by using results of reinforcement learning. We propose a way to apply symbolic processing methods such as C4.5 to results of reinforcement learning where methods of fuzzy inference are incorporated. We also derive a proper action decision tree where conditions of proper actions for agents are effectively integrated and simplified.