Adaptive Routing. Rienforcement Learning Approaches. Contents. Routing Protocols Reinforcement Learning Q-Routing PQ-Routing Ant Routing Summary. Routing Classification. Distributed. Centralized. A Main controller updates all node’s routing tables. Fault Tollerent.
Rienforcement Learning Approaches
node’s routing tables.
among nodes by exchanging.
Adaptive Routing’s the Answer?
Agent Playing against a player- Chess and Tic-Tac-Toe
Learning a Value Function
For K = 0.4 We have
V(e) = 0.5 + 0.2 = 0.7
V(s) = V(s) + K [ V(s’) – V(s) ]
Failure to explore new shortcuts
Finding neighbour y
< 4,0,cost >
Routing Table for 1
normalizing sum of probabilities to 1Ants: Updation
When a router x receives an ant < hd, hs, cost> from neighbor yi, it:
p = k / cost, for some k
pi = pi+ p
for j i, pj = pj
P( ant sent to yi ) = pi
P( ant sent to yi ) = 1 / e