The programme below is tentative and may still be subject to minor changes.
| 09:30–09:45 | Opening remarks |
| 09:45–11:15 | Pierre Tarrès — Minicourse (Lecture 1) |
| 11:15–11:45 | Coffee break |
| 11:45–12:45 | Invited speaker 1 |
| 12:45–14:00 | Lunch break |
| 14:00–15:00 | Invited speaker 2 |
| 15:00–15:30 | Coffee break |
| 15:30–16:30 | Invited speaker 3 |
| 16:30–17:30 | Invited speaker 4 |
| 09:30–11:00 | Pierre Tarrès — Minicourse (Lecture 2) |
| 11:00–11:30 | Coffee break |
| 11:30–12:30 | Invited speaker 5 |
| 12:30–14:00 | Lunch break |
| 14:00–15:00 | Invited speaker 6 |
| 15:00–15:30 | Coffee break |
| 15:30–16:30 | Invited speaker 7 |
| 16:30–17:30 | Invited speaker 8 |
| 09:30–11:00 | Pierre Tarrès — Minicourse (Lecture 3) |
| 11:00–11:30 | Coffee break |
| 11:30–12:30 | Invited speaker 9 |
| 12:30–14:00 | Lunch break |
| 14:00–15:00 | Invited speaker 10 |
| 15:00–15:30 | Coffee break |
| 15:30–17:00 | Discussion session: “Probability meets AI” |
| 09:30–10:30 | Invited speaker 11 |
| 10:30–11:00 | Coffee break |
| 11:00–12:00 | Invited speaker 12 |
| 12:00–12:15 | Closing remarks |
| 12:15–13:30 | Lunch |
Distributional Reinforcement Learning via Moment Matching
In reinforcement learning, an agent typically chooses at each time among a set of Markov kernels so as to maximize some utility function of her path. Distributional Reinforcement Learning (DistRL) aims at estimating the law of the obtained utility. We will present here a DistRL approach that leverage the exact computability of specific moments of the return distribution via generalized dynamic programming. This approach offers a principled and theoretically grounded alternative to existing DistRL policy evaluation and planning methods, with the key advantage to avoid the accumulation of approximations during the iterations. We study the accuracy of generic reconstruction methods of the full return distribution from its computed moments: we prove an error bound on the Wasserstein W1 distance that is independent of the horizon (or discount factor). Then, we focus on the use of the Maximum Entropy principle: under additional regularity assumptions, we prove a much stronger control of the error under the Kullback-Leibler divergence.
Emergence of Monopoly in Non-linear Pólya Urns
Generalized Pólya urns with non-linear feedback are an established probabilistic model to describe the dynamics of competing agents in growth processes with reinforcement. We provide a comprehensive account of the possible asymptotic behaviour for a large general class of feedback, and describe in detail how monopolies emerge in a transition from sub-linear to super-linear feedback via hierarchical states close to linearity. Based on Rubin's exponential embedding, the tail asymptotics for losing agents is related to explosive birth processes conditioned on non-explosion. We also provide a scaling limit for the full time evolution of market shares for diverging initial market size, and apply this to model the dynamics of the wealth distribution through wages and capital returns. This is joint work with Thomas Gottfried (Augsburg).
Convergence of Reinforcement-Learning Algorithms
Abstract to follow.
Branching with selection and mutation
We investigate a stochastic model of a growing population subject to selection and mutation. In our model each individual carries a fitness which determines its mean offspring number. Many of these offspring inherit their parent’s fitness, but some are mutants and obtain a fitness randomly sampled from a fixed distribution. We find the precise rate of growth of the population, identify a regime where a condensation effect occurs and formulate a conjecture for the age and fitness distribution in the population.
Restrictions of some reinforced processes to subgraphs
Processes with reinforcement have been extensively studied in the past decades. Linearly edge-reinforced random walk and the vertex-reinforced jump process are very special because they are mixtures of Markov chains and Markov jump processes, respectively. The restriction of the vertex-reinforced jump process to a subgraph turns out to be a mixture of vertex-reinforced jump processes on the subgraph. This property is used to prove a recurrence result for both the vertex-reinforced jump process and the edge-reinforced random walk on graphs of bounded degree where each edge is replaced by a series of sufficiently many edges. The talk is based on joint work with Margherita Disertori and Franz Merkl.
Edge-reinforced branching random walk on the triangle
Edge-reinforced random walk (ERRW) is a random process on the vertices of a graph that is more likely to cross the edges it has visited in the past. Depending on the strength of the reinforcement, one-dimensional ERRW can either exhibit localisation (eventually moving back and forth across a single edge) or remain transient. We consider a model where a single ERRW is replaced by an exponentially growing number of random particles, and we study its localisation properties on the simple triangle graph. Using the dynamical systems approach we analyse the frequencies with which the edges are traversed and prove their almost sure convergence. We discuss the scenarios when those frequencies become negligible for one or two edges (dominance). We also discuss the situation when an edge stops being traversed entirely (monopoly). This is a joint work with Giordano Giambartolomei.
Tampered Memory Elephant Random Walk on the one-dimensional integer lattice
Abstract to follow.