{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T04:27:42Z","timestamp":1760243262599,"version":"build-2065373602"},"reference-count":45,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2014,6,19]],"date-time":"2014-06-19T00:00:00Z","timestamp":1403136000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/summer-heart-0930.chufeiyun1688.workers.dev:443\/https\/creativecommons.org\/licenses\/by\/3.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Self-organization and survival are inextricably bound to an agent\u2019s ability to control and anticipate its environment. Here we assess both skills when multiple agents compete for a scarce resource. Drawing on insights from psychology, microsociology and control theory, we examine how different assumptions about the behaviour of an agent\u2019s peers in the anticipation process affect subjective control and survival strategies. To quantify control and drive behaviour, we use the recently developed information-theoretic quantity of empowerment with the principle of empowerment maximization. In two experiments involving extensive simulations, we show that agents develop risk-seeking, risk-averse and mixed strategies, which correspond to greedy, parsimonious and mixed behaviour. Although the principle of empowerment maximization is highly generic, the emerging strategies are consistent with what one would expect from rational individuals with dedicated utility models. Our results support empowerment maximization as a universal drive for guided self-organization in collective agent systems.<\/jats:p>","DOI":"10.3390\/e16063357","type":"journal-article","created":{"date-parts":[[2014,6,19]],"date-time":"2014-06-19T11:22:58Z","timestamp":1403176978000},"page":"3357-3378","update-policy":"https:\/\/summer-heart-0930.chufeiyun1688.workers.dev:443\/https\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Effects of Anticipation in Individually Motivated Behaviour on Survival and Control in a Multi-Agent Scenario with Resource Constraints"],"prefix":"10.3390","volume":"16","author":[{"given":"Christian","family":"Guckelsberger","sequence":"first","affiliation":[{"name":"Department of Computer Science, University of Hertfordshire, College Lane, Hatfield HertsAL10 9AB, UK"}]},{"given":"Daniel","family":"Polani","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Hertfordshire, College Lane, Hatfield HertsAL10 9AB, UK"}]}],"member":"1968","published-online":{"date-parts":[[2014,6,19]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Ashby, W.R. (1956). An Introdution to Cybernetics, Chapman & Hall Ltd.","DOI":"10.5962\/bhl.title.5851"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1108\/14636681011049839","article-title":"The Many Aspects of Anticipation","volume":"12","author":"Poli","year":"2010","journal-title":"Foresight"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Butz, M.V., Sigaud, O., and Baldessare, G. (2007). Anticipatory Behavior in Adaptive Learning Systems: From Brains to Individual and Social Behavior, Springer.","DOI":"10.1007\/978-3-540-74262-3"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Butz, M.V., Sigaud, O., Pezzulo, G., and Baldessare, G. (2007). Anticipatory Behavior in Adaptive Learning Systems. From Brains to Individual and Social Behavior, Springer.","DOI":"10.1007\/978-3-540-74262-3"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Butz, M.V., Sigaud, O., and G\u00e9rard, P. (2003). Anticipatory Behaviour in Adaptive Learning Systems, Springer.","DOI":"10.1007\/b11711"},{"key":"ref_6","unstructured":"Broekens, J. (2005, January 21\u201323). Internal Simulation of Behavior Has an Adaptive Advantage, Stresa, Italy."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Lungarella, M., Iida, F., Bongard, J., and Pfeifer, R. (2007). 50 Years of Artificial Intelligence, Springer.","DOI":"10.1007\/978-3-540-77296-5"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Rosen, R. (2012). Anticipatory Systems, Springer.","DOI":"10.1007\/978-1-4614-1269-4"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"e4018","DOI":"10.1371\/journal.pone.0004018","article-title":"Keep your options open: An information-based driving principle for sensorimotor systems","volume":"3","author":"Klyubin","year":"2008","journal-title":"PLoS One"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"2789","DOI":"10.3390\/e16052789","article-title":"Changing the Environment based on Empowerment as Intrinsic Motivation","volume":"16","author":"Salge","year":"2014","journal-title":"Entropy"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1037\/h0092976","article-title":"Generalized expectancies for internal vs. external control of reinforcement","volume":"80","author":"Rotter","year":"1966","journal-title":"Psychol. Monogr"},{"key":"ref_12","unstructured":"Oesterreich, R. (1979). Entwicklung Eines Konzepts der Objektiven Kontrolle und Kontrollkompetenz. Ein Handlungstheoretischer Ansatz. [Ph.D. Thesis, Technische Universit\u00e4t Berlin]. (In German)."},{"key":"ref_13","unstructured":"Gibson, J.J. (1986). The Ecological Approach to Visual Perception, Routledge."},{"key":"ref_14","unstructured":"Klyubin, A.S., Polani, D., and Nehaniv, C.L. (2005). Advances in Artificial Life, Springer."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Von Foerster, H. (2003). Understanding Understanding, Springer.","DOI":"10.1007\/b97451"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1156","DOI":"10.1103\/PhysRevLett.84.1156","article-title":"Information-Theoretic Limits of Control","volume":"84","author":"Touchette","year":"2000","journal-title":"Phys. Rev. Lett"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"140","DOI":"10.1016\/j.physa.2003.09.007","article-title":"Information-Theoretic Approach to the Study of Control Systems","volume":"331","author":"Touchette","year":"2004","journal-title":"Phys. Stat. Mech. Appl"},{"key":"ref_18","unstructured":"Klyubin, A.S., Polani, D., and Nehaniv, C.L. (2004, January 24\u201326). Organization of the Information Flow in the Perception-Action Loop of Evolved Agents, Seattle, WA, USA."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Trendafilov, D., and Murray-Smith, R. (2013, January 13\u201315). Information-Theoretic Characterization of Uncertainty in Manual Control, Lausanne, Switzerland.","DOI":"10.1109\/SMC.2013.835"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Capdepuy, P., Polani, D., and Nehaniv, C.L. (2007, January 1\u20135). Maximization of Potential Information Flow as a Universal Utility for Collective Behaviour, Honolulu, HI, USA.","DOI":"10.1109\/ALIFE.2007.367798"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1007\/s12064-011-0143-y","article-title":"Perception-action loops of multiple agents: informational aspects and the impact of coordination","volume":"131","author":"Capdepuy","year":"2011","journal-title":"Theor. Biosci"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Butz, M.V., Sigaud, O., and G\u00e9rard, P. (2003). Anticipatory Behavior: Exploiting Knowledge About the Future to Improve Current Behavior, Springer.","DOI":"10.1007\/978-3-540-45002-3_1"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Butz, M.V., Sigaud, O., and G\u00e9rard, P. (2003). Anticipatory Behaviour in Adaptive Learning Systems, Springer.","DOI":"10.1007\/b11711"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Pezzulo, G., Butz, M.V., Castelfranchi, C., and Falcone, R. (2008). The Challenge of Anticipation. A Unifying Framework for the Analysis and Design of Artificial Cognitive Systems, Springer.","DOI":"10.1007\/978-3-540-87702-8"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Byrski, A., Oplatkov\u00e1, Z., Carvalho, M., and Kisiel-Dorohinicki, M. (2012). Advances in Intelligent Modelling and Simulation, Springer.","DOI":"10.1007\/978-3-642-28888-3"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Butz, M.V., Sigaud, O., and G\u00e9rard, P. (2003). Anticipatory Behaviour in Adaptive Learning Systems, Springer.","DOI":"10.1007\/b11711"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"242","DOI":"10.1016\/S1364-6613(02)01913-7","article-title":"Conscious thought as simulation of behaviour and perception","volume":"6","author":"Hesslow","year":"2002","journal-title":"Trends Cognit. Sci"},{"key":"ref_28","unstructured":"Capdepuy, P., Polani, D., and Nehaniv, C.L. (2007). Advances in Artificial Life, Springer."},{"key":"ref_29","unstructured":"Capdepuy, P., Polani, D., and Nehaniv, C.L. (2007). Lecture Notes in Computer Science, Springer."},{"key":"ref_30","unstructured":"Capdepuy, P., Polani, D., and Nehaniv, C.L. (, January 22\u201325). Adaptation of the Perception-Action Loop Using Active Channel Sampling, Noordwijk, The Netherlands."},{"key":"ref_31","unstructured":"Davidsson, P. (1997). Distributed Artificial Intelligence Meets Machine Learning Learning in Multi-Agent Environments, Springer."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"319","DOI":"10.1023\/A:1010028119149","article-title":"Rational coordination in multi-agent environments","volume":"3","author":"Gmytrasiewicz","year":"2000","journal-title":"Autonom. Agents Multi-Agent Syst"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1017\/S0140525X03000050","article-title":"Cooperation, psychological game theory, and limitations of rationality in social interaction","volume":"26","author":"Colman","year":"2003","journal-title":"Behav. Brain. Sci"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Pezzulo, G., Butz, M.V., Sigaud, O., and Baldassarre, G. (2009). Anticipatory Behavior in Adaptive Learning Systems. From Psychological Theories to Artificial Cognitive Systems, Springer.","DOI":"10.1007\/978-3-642-02565-5"},{"key":"ref_35","unstructured":"Veloso, M., Stone, P., and Bowling, M. (1999, January 19\u201320). Anticipation: A key for collaboration in a team of agents, Boston, MA, USA."},{"key":"ref_36","unstructured":"Sharifi, M., Mousavian, H., and Aavani, A. (2003, January 5\u20138). Predicting the Future State of the Robocup Simulation Environment: Heuristic and Neural Networks Approaches, Washington, DC, USA."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Pezzulo, G., Butz, M.V., Sigaud, O., and Baldassarre, G. (2009). Anticipatory Behavior in Adaptive Learning Systems. From Psychological Theories to Artificial Cognitive Systems, Springer.","DOI":"10.1007\/978-3-642-02565-5"},{"key":"ref_38","first-page":"3","article-title":"Some cognitive breakthroughs in the evolution of cognition and consciousness, and their impact on the biology of language","volume":"1","year":"1995","journal-title":"Evol. Cognit"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"460","DOI":"10.1109\/TIT.1972.1054855","article-title":"Computation of channel capacity and rate-distortion functions","volume":"18","author":"Blahut","year":"1972","journal-title":"IEEE Trans. Inform. Theor"},{"key":"ref_40","first-page":"345","article-title":"Meaningful Information, Sensor Evolution, and the Temporal Horizon of Embodied Organisms","volume":"8","author":"Nehaniv","year":"2002","journal-title":"Artif. Life"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/TCIAIG.2013.2295372","article-title":"General Self-Motivation and Strategy Identification: Case Studies based on Sokoban and Pac-Man","volume":"6","author":"Anthony","year":"2014","journal-title":"IEEE Trans. Comput. Intell. AI Games"},{"key":"ref_42","unstructured":"Martinho, C., and Paiva, A. (2006, January 16\u201320). Using Anticipation to Create Believable Behaviour, Boston, MA, USA."},{"key":"ref_43","unstructured":"Wolff, K. (1950). The Sociology of Georg Simmel, Simon and Schuster."},{"key":"ref_44","unstructured":"Seligman, M.E.P. (1975). Helplessness: On Depression, Development, and Death, WH Freeman\/Times Books\/Henry Holt & Co."},{"key":"ref_45","unstructured":"Edge, R. (2013). Predicting Player Churn in Multiplayer Games using Goal-Weighted Empowerment, University of Minnesota."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/summer-heart-0930.chufeiyun1688.workers.dev:443\/https\/www.mdpi.com\/1099-4300\/16\/6\/3357\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T21:12:41Z","timestamp":1760217161000},"score":1,"resource":{"primary":{"URL":"https:\/\/summer-heart-0930.chufeiyun1688.workers.dev:443\/https\/www.mdpi.com\/1099-4300\/16\/6\/3357"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2014,6,19]]},"references-count":45,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2014,6]]}},"alternative-id":["e16063357"],"URL":"https:\/\/summer-heart-0930.chufeiyun1688.workers.dev:443\/https\/doi.org\/10.3390\/e16063357","relation":{},"ISSN":["1099-4300"],"issn-type":[{"type":"electronic","value":"1099-4300"}],"subject":[],"published":{"date-parts":[[2014,6,19]]}}}