4.7 Article

Reinforcement learning accounts for moody conditional cooperation behavior: experimental results

期刊

SCIENTIFIC REPORTS
卷 7, 期 -, 页码 -

出版社

NATURE PUBLISHING GROUP
DOI: 10.1038/srep39275

关键词

-

资金

  1. JST, ERATO, Kawarabayashi Large Graph Project
  2. Japan Society for the Promotion of Science [15K13111, 24653166]
  3. Grants-in-Aid for Scientific Research [17KT0001, 15K13111, 16H06324, 24653166, 15K17262, 15K13007, 15H05728] Funding Source: KAKEN

向作者/读者索取更多资源

In social dilemma games, human participants often show conditional cooperation (CC) behavior or its variant called moody conditional cooperation (MCC), with which they basically tend to cooperate when many other peers have previously cooperated. Recent computational studies showed that CC and MCC behavioral patterns could be explained by reinforcement learning. In the present study, we use a repeated multiplayer prisoner's dilemma game and the repeated public goods game played by human participants to examine whether MCC is observed across different types of game and the possibility that reinforcement learning explains observed behavior. We observed MCC behavior in both games, but the MCC that we observed was different from that observed in the past experiments. In the present study, whether or not a focal participant cooperated previously affected the overall level of cooperation, instead of changing the tendency of cooperation in response to cooperation of other participants in the previous time step. We found that, across different conditions, reinforcement learning models were approximately as accurate as a MCC model in describing the experimental results. Consistent with the previous computational studies, the present results suggest that reinforcement learning may be a major proximate mechanism governing MCC behavior.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.7
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

Article Neurosciences

Recurrence quantification analysis of dynamic brain networks

Marinho A. Lopes, Jiaxiang Zhang, Dominik Krzeminski, Khalid Hamandi, Qi Chen, Lorenzo Livi, Naoki Masuda

Summary: Brain network dynamics are crucial for brain function and dysfunction, and a new framework using recurrence analysis has been proposed to assess the dynamics of brain networks. The recurrence of dFNs may serve as a biomarker for epilepsy, and recurrence analysis can also help detect seizures and inform neurostimulation strategies. This framework can be applied not only to epilepsy but also to understand dFNs in healthy brain function and other neurological disorders.

EUROPEAN JOURNAL OF NEUROSCIENCE (2021)

Article Neurosciences

Modelling state-transition dynamics in resting-state brain signals by the hidden Markov and Gaussian mixture models

Takahiro Ezaki, Yu Himeno, Takamitsu Watanabe, Naoki Masuda

Summary: Recent studies have suggested that summarizing brain activity into hidden states dynamics is a promising tool for understanding brain function. Hidden Markov models (HMMs) are commonly used to infer neural dynamics, but the impact of assuming Markovian structure in neural time series data needs further examination. Comparisons between GMM and HMM show that HMM generally provides better accuracy in estimating hidden states, but GMM can be a viable alternative under certain conditions like low sampling frequency or short data length.

EUROPEAN JOURNAL OF NEUROSCIENCE (2021)

Article Multidisciplinary Sciences

Detecting anomalous citation groups in journal networks

Sadamori Kojaku, Giacomo Livan, Naoki Masuda

Summary: The intense competition in the academic publishing market drives journal editors to pursue higher impact factors, but the fixation on impact factors can lead to some journals artificially boosting their impact factors. The rise of citation cartel behavior is becoming more common, and the CIDRE algorithm is able to detect these anomalies effectively.

SCIENTIFIC REPORTS (2021)

Article Psychology, Multidisciplinary

Conjecturing Harmful Intent and Preemptive Strike in Paranoia

Yutaka Horita

Summary: The research shows that individuals with high levels of paranoia are more likely to perceive harmful intent in others, potentially leading to increased aggressive behavior. Paranoia is also related to aggressiveness, as well as assumptions about others' self-interests and competitiveness.

FRONTIERS IN PSYCHOLOGY (2021)

Article Biology

Epidemic dynamics on metapopulation networks with node2vec mobility

Lingqi Meng, Naoki Masuda

Summary: Metapopulation models are a useful tool for studying epidemic dynamics. In this study, the effects of different mobility rules on epidemic dynamics in a metapopulation model were compared. It was found that using a second-order random-walk mobility rule called node2vec tends to suppress epidemic spreading, while simple random walks have less impact. The change in epidemic threshold induced by node2vec mobility is generally smaller than the change induced by the diffusion rate.

JOURNAL OF THEORETICAL BIOLOGY (2022)

Article Multidisciplinary Sciences

Temporal motifs in patent opposition and collaboration networks

Penghang Liu, Naoki Masuda, Tomomi Kito, Ahmet Erdem Sariyuce

Summary: This study examines the relationship between patent oppositions and collaborations by constructing a two-layer temporal network. The findings suggest that large companies are more likely to engage in patent oppositions with multiple companies, and adversarial companies are more likely to collaborate in the future.

SCIENTIFIC REPORTS (2022)

Article Multidisciplinary Sciences

Mean-field theory for double-well systems on degree-heterogeneous networks

Prosenjit Kundu, Neil G. MacLaren, Hiroshi Kori, Naoki Masuda

Summary: In this paper, a degree-based mean-field theory is developed for understanding the coupled tipping dynamics in a network of double-well systems. The study provides evidence for multistage tipping point transitions in such networks.

PROCEEDINGS OF THE ROYAL SOCIETY A-MATHEMATICAL PHYSICAL AND ENGINEERING SCIENCES (2022)

Article Multidisciplinary Sciences

Paranoid thinking and perceived competitive intention

Yutaka Horita

Summary: This study found that paranoid thinking exists even in the general population. It is characterized by the expectation that others are competitors who aim to maximize differences in payoffs rather than maximizing their own payoffs. The study used a modified Dictator Game and found that individuals with high-level paranoid thinking were more likely to anticipate competitive allocations by their opponents, even when it was costly for the Dictators. However, paranoid thinking was not associated with selecting sure rewards or competitive allocations.
Article Psychology, Multidisciplinary

Generalized Trust Rather than Perception of Relational Mobility Correlates with Nominating Close Friends in a Social Network1

Yutaka Horita, Miku Yamazaki

Summary: The social environment has an impact on individuals' psychology and social networks. Generalized trust is associated with an individual's social ties, while perception of relational mobility has no significant association with trust or social network measures.

JAPANESE PSYCHOLOGICAL RESEARCH (2023)

Article Neuroimaging

Motor function and white matter connectivity in children cooled for neonatal encephalopathy

Arthur P. C. Spencer, Jonathan C. W. Brooks, Naoki Masuda, Hollie Byrne, Richard Lee-Kelland, Sally Jary, Marianne Thoresen, Marc Goodfellow, Frances M. Cowan, Ela Chakkarapani

Summary: Therapeutic hypothermia in children treated for neonatal hypoxic-ischaemic encephalopathy reduces severe motor disability but leads to motor deficits and altered white matter connectivity in those without cerebral palsy. Diffusion-weighted imaging showed significant correlations between white matter tracts and motor performance in cases but not controls. Network analysis revealed associations between impaired motor function and brain organization in cases, highlighting the impact of therapeutic hypothermia on brain development.

NEUROIMAGE-CLINICAL (2021)

Article Physics, Fluids & Plasmas

Finite-size effects on the convergence time in continuous-opinion dynamics

Hang-Hyun Jo, Naoki Masuda

Summary: The study shows that in lattice networks, the convergence time increases as the system size increases, while in regular random graphs, uncorrelated scale-free networks, and complete graphs, the convergence time is almost independent of the system size unless individuals perfectly copy their neighbors' opinions in each update. A mean-field analysis of the complete graph case is also provided.

PHYSICAL REVIEW E (2021)

Article Physics, Multidisciplinary

Opinion dynamics on tie-decay networks

Kashin Sugishita, Mason A. Porter, Mariano Beguerisse-Diaz, Naoki Masuda

Summary: Opinion dynamics on tie-decay networks involve interaction patterns that change over time, with tie strength increasing instantaneously and decaying exponentially between interactions. Numerical computations for continuous-time Laplacian dynamics reveal the spectral gaps of combinatorial Laplacian matrices of tie-decay networks. The study compares spectral gaps of empirical tie-decay networks with randomized and aggregate networks, showing smaller gaps in empirical networks, and explores the relationship between spectral gap, tie-decay rate, and time. The results emphasize the importance of the interplay between edge strengthening and decaying in temporal networks.

PHYSICAL REVIEW RESEARCH (2021)

Article Neuroimaging

Disrupted brain connectivity in children treated with therapeutic hypothermia for neonatal encephalopathy

Arthur P. C. Spencer, Jonathan C. W. Brooks, Naoki Masuda, Hollie Byrne, Richard Lee-Kelland, Sally Jary, Marianne Thoresen, James Tonks, Marc Goodfellow, Frances M. Cowan, Ela Chakkarapani

Summary: Therapeutic hypothermia for neonatal encephalopathy following birth asphyxia reduces death and cerebral palsy risks, but school-age children treated with this method still show cognitive and motor deficits compared to controls. Diffusion-weighted imaging revealed widespread changes in white matter structure in these children. Network-based statistic analysis identified brain regions associated with visuo-spatial processing and attention as being affected.

NEUROIMAGE-CLINICAL (2021)

Review Multidisciplinary Sciences

Concurrency measures in the era of temporal network epidemiology: a review

Naoki Masuda, Joel C. Miller, Petter Holme

Summary: Diseases spread through temporal networks of interaction events, with the structure of these networks being crucial for understanding epidemic propagation. Concurrency, the concept of individuals forming time-overlapping 'partnerships', plays a key role in this understanding, particularly in sexual transmitted infections. Despite conflicting evaluations and various definitions, concurrency remains significant in epidemiology research.

JOURNAL OF THE ROYAL SOCIETY INTERFACE (2021)

Editorial Material Economics

Introduction to the special issue Economics and Complex Networks

Teruyoshi Kobayashi, Naoki Masuda

JAPANESE ECONOMIC REVIEW (2021)

暂无数据