On-line learning is one of the most commonly used techniques for training large layered networks. Traditional methods have been recently complemented by ones from statistical physics and Bayesian statistics to provide more insight and deeper understanding of existing algorithms. This book presents a coherent picture of the state-of-the-art.