We have decided to discontinue the publication of preprints on our preprint server as of 1 March 2024. The publication culture within mathematics has changed so much due to the rise of repositories such as ArXiV (www.arxiv.org) that we are encouraging all institute members to make their preprints available there. An institute's repository in its previous form is, therefore, unnecessary. The preprints published to date will remain available here, but we will not add any new preprints here.
MiS Preprint
14/1999
Homeokinesis - A new principle to back up evolution with learning
Ralf Der, Ulrich Steinmetz and Frank Pasemann
Abstract
It is well known that individual learning can speed up artificial evolution enormously. However both supervised learning and reinforcement learning require specific learning goals which usually are not available or difficult to find. We introduce a new principle - homeokinesis - which is completely unspecific and yet induces specific, seemingly goal-oriented behaviors of an agent in a complex external world. The principle is based on the assumption that the agent is equipped with an adaptive model of its behavior. A learning signal for both the model and the controller is derived from the misfit between the real behavior of the agent in the world and that predicted by the model. If the structural complexity of the model is chosen adequately, this misfit is minimized if the agent exhibits a smooth controlled behavior. The principle is explicated by two examples. We moreover discuss how functional modularization emerges in a natural way in a structured system from a mechanism of competition for the best internal representation.
Homeokinesis : a new principle to back up evolution with learning
In: Computational Intelligence for Modelling, Control and Automation / Masoud Mohammadian (ed.) Amsterdam [u.a.] : IOS Press, 1999. - pp. 43-47 (Concurrent Systems Engineering Series ; 55)
