Vertex-reinforced random walks and a conjecture of pemantle
Author(s)
Date issued
1997
In
Annals of Probability
Vol
1
No
25
From page
361
To page
392
Subjects
reinforced random walks random perturbations of dynamical systems chain recurrence attractors STOCHASTIC APPROXIMATIONS ALGORITHMS DYNAMICS
Abstract
We discuss and disprove a conjecture of Pemantle concerning vertex-reinforced random walks. The setting is a general theory of non-Markovian discrete-time random processes on a finite space E = {1,...,d}, for which the transition probabilities at each step are influenced by the proportion of times each state has been visited. It is shown that, under mild conditions, the asymptotic behavior of the empirical occupation measure of the process is precisely related to the asymptotic behavior of some deterministic dynamical system induced by a vector field on the d - 1 unit simplex. In particular, any minimal attractor of this vector field has a positive probability to be the Limit set of the sequence of empirical occupation measures. These properties are used to disprove a conjecture and to extend some results due to Pemantle. Some applications to edge-reinforced random walks are also considered.
Publication type
journal article
File(s)
