Abstract

One of the problems in reinforcement learning is that as the environment becomes more complex, the number of parameters used in decision making increase which leads us to a slow decision making process. The main idea here is to come up with a new algorithm which is able to transfer the information, using data mining techniques in extracting the patterns. We introduce a new algorithm for state transitions and actions which happen during the transfer by the agent are saved as a data set for data mining techniques which is presented Learning With Action Transfer (LAT). The main idea is to use the repeated action in each state, as a pattern in similar states as a means to improve learning speed and performance. The results in our algorithm will be compared to the results in Q-learning algorithm. .

References

• R. Sutton and A. Barto, Introduction to Reinforcement Learning, MIT Press, Cambridge (1998).
• L. P. Kaelbling, M. L. Littman and A. W. Moore, Reinforcement learning: A survey, Journal of Artificial Intelligence Research 4 (1996), pp. 237–285.
• Matthew E. Taylor, Gregory Kuhlmann, Peter Stone: Autonomous transfer for reinforcement learning. AAMAS (1) 2008: 283-290
• Oliver G. Selfridge, Richard S. Sutton, and Andrew G. Barto. Training and tracking in robotics.
• Minoru Asada, Shoichi Noda, Sukoya Tawaratsumida, and Koh Hosoda. Vision-based behavior acquisition for a shooting robot by using a reinforcement learning. In Proceedings of IAPR/IEEE Workshop on Visual Behaviors-1994, pages 112–118, 1994.
• Christopher G. Atkeson and Juan C. Santamaria. A comparison of direct and model-based reinforcement learning. In Proceedings of the 1997 International Conference on Robotics and Automation.
• Mehran Asadi and Manfred Huber. Effective control knowledge transfer through learning skill and representation hierarchies. In Proceedings of the 20th International Joint Conference on Artificial Intelligence, 2007 , pages 2054–2059.
• Balaraman Ravindran and Andrew G. Barto. Model minimization in hierarchical reinforcement learning. In Proceedings of the Fifth Symposium on Abstraction, Reformulation and Approximation, 2002
• Kimberly Ferguson and Sridhar Mahadevan. Proto-transfer learning in Markov decision processes using spectral methods. In Proceedings of the ICML-06 Workshop on Structural Knowledge Transfer for Machine Learning, June 2006
• T. Dietterich, Hierarchical reinforcement learning with the MAXQ value function decomposition, Journal of Artificial Intelligence Research 3(2000) 227_303.
• P. Dayan, C. Watkins, Q-learning, Machine Learning 8 (1992) 279_292.
• Morgan Kaufmann Publishers is an imprint of Elsevier500 Sansome Street, Suite 400, San Francisco, CA94111Page468-489
• Cheng-Ping Lai, Pau-Choo Chung, Vincent S. Tseng: two-level clustering method for time series data analysis. Expert Syst. Appl (2010), 37