期刊
JOURNAL OF PHYSIOLOGY-PARIS
卷 107, 期 1-2, 页码 107-115出版社
ELSEVIER SCI LTD
DOI: 10.1016/j.jphysparis.2012.06.004
关键词
Intrinsic reward; Whiskers; Curiosity loop; Perception; Palpation
资金
- EU [ICT-215910]
- Israeli Science Foundation [749/10]
- United States-Israel Bi-national Science Foundation (BSF) [2007121]
- Minerva Foundation
- Federal German Ministry for Education and Research
- Clore fellowship
Rats move their whiskers to acquire information about their environment. It has been observed that they palpate novel objects and objects they are required to localize in space. We analyze whisker-based object localization using two complementary paradigms, namely, active learning and intrinsic-reward reinforcement learning. Active learning algorithms select the next training samples according to the hypothesized solution in order to better discriminate between correct and incorrect labels. Intrinsic-reward reinforcement learning uses prediction errors as the reward to an actor-critic design, such that behavior converges to the one that optimizes the learning process. We show that in the context of object localization, the two paradigms result in palpation whisking as their respective optimal solution. These results suggest that rats may employ principles of active learning and/or intrinsic reward in tactile exploration and can guide future research to seek the underlying neuronal mechanisms that implement them. Furthermore, these paradigms are easily transferable to biomimetic whisker-based artificial sensors and can improve the active exploration of their environment. (C) 2012 Elsevier Ltd. All rights reserved.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据