TY - GEN
T1 - Adaptive routing for sensor networks using reinforcement learning
AU - Ping, Wang
AU - Ting, Wang
PY - 2006
Y1 - 2006
N2 - Efficient and robust routing is central to wireless sensor networks (WSN) that feature energy-constrained nodes, unreliable links, and frequent topology change. While most existing routing techniques are designed to reduce routing cost by optimizing one goal, e.g., routing path length, load balance, re-transmission rate, etc, in real scenarios however, these factors affect the routing performance in a complex way, leading to the need of a more sophisticated scheme that makes correct trade-offs. In this paper, we present a novel routing scheme, AdaR that adaptively learns an optimal routing strategy, depending on multiple optimization goals. We base our approach on a least squares reinforcement learning technique, which is both data efficient, and insensitive against initial setting, thus ideal for the context of ad-hoc sensor networks. Experimental results suggest a significant performance gain over a naïve Q-learning based implementation.
AB - Efficient and robust routing is central to wireless sensor networks (WSN) that feature energy-constrained nodes, unreliable links, and frequent topology change. While most existing routing techniques are designed to reduce routing cost by optimizing one goal, e.g., routing path length, load balance, re-transmission rate, etc, in real scenarios however, these factors affect the routing performance in a complex way, leading to the need of a more sophisticated scheme that makes correct trade-offs. In this paper, we present a novel routing scheme, AdaR that adaptively learns an optimal routing strategy, depending on multiple optimization goals. We base our approach on a least squares reinforcement learning technique, which is both data efficient, and insensitive against initial setting, thus ideal for the context of ad-hoc sensor networks. Experimental results suggest a significant performance gain over a naïve Q-learning based implementation.
UR - http://www.scopus.com/inward/record.url?scp=34547271882&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=34547271882&partnerID=8YFLogxK
U2 - 10.1109/CIT.2006.34
DO - 10.1109/CIT.2006.34
M3 - Conference contribution
AN - SCOPUS:34547271882
SN - 076952687X
SN - 9780769526874
T3 - Proceedings - Sixth IEEE International Conference on Computer and Information Technology, CIT 2006
SP - 219
BT - Proceedings - Sixth IEEE International Conference on Computer and Information Technology, CIT 2006
PB - IEEE Computer Society
T2 - 6th IEEE International Conference on Computer and Information Technology, CIT 2006
Y2 - 20 September 2006 through 22 September 2006
ER -