Article
Neurosciences
Karita E. Ojala, Athina Tzovara, Benedikt A. Poser, Antoine Lutti, Dominik R. Bach
Summary: Survival in biological environments requires learning associations between predictive sensory cues and threatening outcomes, which may be implemented through reinforcement learning algorithms driven by prediction errors (PEs). This study investigated the neural representation of PEs during maintenance of learned aversive associations using fMRI, revealing that PEs were encoded in the medial prefrontal cortex during the omission of aversive outcomes.
Article
Biochemistry & Molecular Biology
Daniel N. Peng, Thomas R. Zentall
Summary: Humans can learn tasks explicitly, but animals learn tasks implicitly through associative learning. Humans are unable to learn the 1-back rule, while pigeons can learn it gradually through associative learning. These results suggest that explicit learning in humans may interfere with their learning abilities, while pigeons are not distracted by explicit learning.
Article
Food Science & Technology
Luana P. Queiroz, Carine M. Rebello, Erbet A. Costa, Vinicius V. Santana, Bruno C. L. Rodrigues, Alirio E. Rodrigues, Ana M. Ribeiro, Idelfonso B. R. Nogueira
Summary: This work proposes a novel framework based on scientific machine learning to tackle an emerging problem in flavor engineering and industry. By combining generative and reinforcement learning models, new flavor molecules are designed. The potential of the framework is validated by evaluating the synthesis accessibility, number of atoms, and likeness to natural or pseudo-natural products of the designed molecules.
Article
Computer Science, Artificial Intelligence
Prachi Pratyusha Sahoo, Aris Kanellopoulos, Kyriakos G. Vamvoudakis
Summary: This article presents a novel intermittent learning scheme based on Skinner's operant conditioning techniques, which approximates the optimal policy while decreasing information transfer. Traditional reinforcement learning schemes can lead to overutilization of limited resources and face the risk of malicious interference. Simulation results demonstrate the efficacy of the proposed approach.
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS
(2023)
Article
Computer Science, Artificial Intelligence
Zhipeng Zhang, Zhimin Wei, Zhongzhen Huang, Rui Niu, Peng Wang
Summary: Referring Expression Comprehension (REC) is a crucial task in visual reasoning, which involves detecting the target object referred to in a natural language expression. One-stage Referring Expression Comprehension (OSREC) models have become popular due to their merging of region proposal and selection stages, and their adoption of a multi-hop reasoning strategy. However, a limitation of these models is the pre-defined and fixed number of reasoning steps, ignoring the varying complexity of expressions. This paper presents a Dynamic Multi-step Reasoning Network, which allows for dynamically adjusting the reasoning steps based on the reasoning state and expression complexity.
Article
Automation & Control Systems
Qinglai Wei, Tao Li, Derong Liu
Summary: The article introduces a deep reinforcement learning method to address air conditioning control problems with human expressions as input, aiming to improve work efficiency by eliminating human sleepiness.
IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS
(2021)
Review
Agriculture, Dairy & Animal Science
Denis J. Meehan, Ana R. J. Cabrita, Margarida R. G. Maia, Antonio J. M. Fonseca
Summary: Nutritional scientists have long been puzzled by how ruminants metabolically respond when they do not consume external energy. Studies using intragastric infusion technique (IIT) show that ruminants can maintain body protein even in a glucose-deficient state. However, questions remain about the validity of certain assumptions in current feeding systems.
Review
Behavioral Sciences
Arthur Prevel, Ruth M. Krebs
Summary: In a new environment, humans and animals can learn and adapt through Pavlovian conditioning. Studies on higher-order Pavlovian conditioning have shown that complex representations of task structures can guide behavior in humans and animals.
FRONTIERS IN BEHAVIORAL NEUROSCIENCE
(2021)
Article
Computer Science, Information Systems
Yi Peng, Haojun Shen, Xiaochang Tang, Sizhe Zhang, Jinxiao Zhao, Yuru Liu, Yuming Nie
Summary: Finding the optimal energy-saving control strategy for HVAC systems has become crucial in realizing energy savings, emission reductions, and green buildings. Deep reinforcement learning (DRL) provides new ideas for HVAC energy consumption optimization. This study proposes a DRL-based framework for HVAC energy consumption optimization, which includes a CNN-LSTM model for energy consumption prediction and an enhanced DDPG algorithm for real-time energy consumption control.
Article
Computer Science, Artificial Intelligence
Zhong Cao, Xiang Li, Kun Jiang, Weitao Zhou, Xiaoyu Liu, Nanshan Deng, Diange Yang
Summary: This work proposes a method of continually learning to improve the performance of autonomous vehicles by establishing a disengagement-imagination environment and training the policy using imagination data. The results show that the DICL agent can handle emerging disengagement cases effectively.
IEEE TRANSACTIONS ON INTELLIGENT VEHICLES
(2023)
Article
Biology
Won Joon Yun, MyungJae Shin, Soyi Jung, JeongGil Ko, Hyung-Chul Lee, Joongheon Kim
Summary: In this work, a deep reinforcement learning-based approach is proposed as a baseline system for autonomous propofol infusion control. The approach includes designing an environment to simulate possible conditions of a target patient based on input demographic data, and a reinforcement learning model-based system to effectively predict the appropriate level of propofol infusion. Through extensive evaluations using patient data, the proposed method demonstrates stabilization of anesthesia state by managing the bispectral index and effect-site concentration for patients with varying conditions.
COMPUTERS IN BIOLOGY AND MEDICINE
(2023)
Article
Energy & Fuels
Mingkun Dai, Hangxin Li, Shengwei Wang
Summary: Air-conditioning systems in commercial buildings often face the challenge of providing sufficient cooling capacity during the morning start period, resulting in imbalanced cooling distribution and extended precooling time. This study proposes an iterative learning control strategy using reinforcement learning to achieve uniform cooling among building zones. Validation tests show that the proposed strategy can significantly reduce precooling time and daily energy consumption.
Article
Computer Science, Interdisciplinary Applications
Rih-Teng Wu, Ting-Wei Liu, Mohammad R. Jahanshahi, Fabio Semperlotti
Summary: Metamaterial systems have opened new possibilities for designing acoustic devices. This study introduces two machine learning-based approaches for designing one-dimensional periodic and non-periodic metamaterial systems. The RL-based method is efficient for periodic metamaterial design, while the NN-based method is effective for non-periodic metamaterial design without the need for pre-defined material unit cell numbers.
STRUCTURAL AND MULTIDISCIPLINARY OPTIMIZATION
(2021)
Article
Energy & Fuels
Huan Zhao, Junhua Zhao, Ting Shu, Zibin Pan
Summary: Buildings consume a large proportion of energy, with HVAC systems being a major contributor. The use of deep reinforcement learning (DRL) is proposed to optimize HVAC control, with a hybrid-model-based approach improving efficiency and reducing learning costs. The method is tested using simulation data and demonstrates reduced energy costs and improved learning efficiency compared to traditional methods.
FRONTIERS IN ENERGY RESEARCH
(2021)
Review
Ecology
Elisabeth Adam, Bill S. Hansson, Markus Knaden
Summary: Despite having small brains, insects are capable of learning from their experiences and making decisions regarding foraging, choosing mates, oviposition, and navigation. This learning process can be surprisingly fast, with a single encounter shaping an insect's behavior for a lifetime. This review discusses the extent and limitations of insect learning, especially focusing on olfactory learning, and questions whether current learning paradigms in lab set-ups can address ecologically relevant questions.
FRONTIERS IN ECOLOGY AND EVOLUTION
(2022)
Article
Physiology
Anthony Sclafani, Hermann Koepsell, Karen Ackroff
AMERICAN JOURNAL OF PHYSIOLOGY-REGULATORY INTEGRATIVE AND COMPARATIVE PHYSIOLOGY
(2016)
Article
Nutrition & Dietetics
Alan C. Spector, Carel W. le Roux, Steven D. Munger, Susan P. Travers, Anthony Sclafani, Julie A. Mennella
JOURNAL OF PARENTERAL AND ENTERAL NUTRITION
(2017)
Article
Pharmacology & Pharmacy
Tamar T. Kraft, Donald Huang, Sam LaMagna, Deena Warshaw, Elona Natanova, Anthony Sclafani, Richard J. Bodnar
EUROPEAN JOURNAL OF PHARMACOLOGY
(2017)
Article
Psychology, Biological
P. S. Hogenkamp, A. Shechter, M-P St-Onge, A. Sciafani, H. R. Kissileff
PHYSIOLOGY & BEHAVIOR
(2017)
Article
Psychology, Biological
Anthony Sclafani, Karen Ackroff
PHYSIOLOGY & BEHAVIOR
(2017)
Article
Physiology
Anthony Sclafani, Karen Ackroff
AMERICAN JOURNAL OF PHYSIOLOGY-REGULATORY INTEGRATIVE AND COMPARATIVE PHYSIOLOGY
(2018)
Article
Physiology
Anthony Sclafani, Karen Ackroff
AMERICAN JOURNAL OF PHYSIOLOGY-REGULATORY INTEGRATIVE AND COMPARATIVE PHYSIOLOGY
(2018)
Article
Psychology, Biological
Anthony Sclafani
PHYSIOLOGY & BEHAVIOR
(2018)
Article
Psychology, Biological
Anthony Sclafani, Austin S. Vural, Karen Ackroff
PHYSIOLOGY & BEHAVIOR
(2018)
Article
Psychology, Biological
Anthony Sclafani, Karen Ackroff
PHYSIOLOGY & BEHAVIOR
(2019)
Article
Physiology
John Glendinning, Jennifer Maleh, Gabriella Ortiz, Khalid Touzani, Anthony Sclafani
AMERICAN JOURNAL OF PHYSIOLOGY-REGULATORY INTEGRATIVE AND COMPARATIVE PHYSIOLOGY
(2020)
Article
Psychology, Biological
Anthony Sclafani, Steven Zukerman, Karen Ackroff
PHYSIOLOGY & BEHAVIOR
(2020)
Article
Psychology, Biological
Anthony Sclafani, Alexander Castillo, Ion Carata, Rachel Pines, Eli Berglas, Serena Joseph, Joymin Sarker, Mirna Nashed, Matthew Roland, Sebastian Arzayus, Niki Williams, John I. Glendinning, Richard J. Bodnar
Summary: This study investigated the effects of isomaltulose and allulose, two alternative sugars, on appetite and preference in mice. The results showed that isomaltulose had a weaker appetite effect, while allulose induced aversion in mice. Additionally, the preference for isomaltulose over sucrose could be altered by adding a noncaloric sweetener mixture.
PHYSIOLOGY & BEHAVIOR
(2023)
Article
Behavioral Sciences
Anthony Sclafani, Austin S. Vural, Karen Ackroff
Article
Physiology
John I. Glendinning, Yonina G. Frim, Ayelet Hochman, Gabrielle S. Lubitz, Anthony J. Basile, Anthony Sclafani
AMERICAN JOURNAL OF PHYSIOLOGY-REGULATORY INTEGRATIVE AND COMPARATIVE PHYSIOLOGY
(2017)
Article
Psychology, Biological
Umit Yilmaz, Kevser Tanbek
Summary: This study investigated the effects of intracerebroventricular administration of Spexin on the hypothalamus-pituitary-thyroid axis and energy expenditure in rats. The results showed that Spexin reduced food consumption and body weight, increased thyroid hormones, and enhanced energy metabolism.
PHYSIOLOGY & BEHAVIOR
(2024)
Article
Psychology, Biological
Kuei-Yu Chien, Yun-Ju Chen, Kuo-Jen Hsu, Chiao-Nan Chen
Summary: This study investigated the effects of a high-protein diet and high-intensity interval training on appetite and weight loss in obese middle-aged individuals. The results showed that consuming a high-protein drink and following a high-protein diet after exercise can reduce post-exercise appetite and the frequency of late-night snacking.
PHYSIOLOGY & BEHAVIOR
(2024)
Review
Psychology, Biological
Melissa Alves Braga Oliveira, Ana Carolina Odebrecht Vergne de Abreu, Debora Barroggi Constantino, Andre C. Tonon, Antoni Diez-Noguera, Fernanda Gaspar Amaral, Maria Paz Hidalgo
Summary: Biological processes in living organisms exhibit strong rhythmicity and are regulated by internal timing systems. Understanding the influence of biological rhythms is crucial for experimental design and reporting.
PHYSIOLOGY & BEHAVIOR
(2024)
Article
Psychology, Biological
Yanqun Cao, Hao Chen, Yinna Tan, Xu-Dong Yu, Chuli Xiao, Yin Li, James Reilly, Zhiming He, Xinhua Shu
Summary: There is evidence to suggest that chronic stress impacts neurochemical homeostasis and contributes to mental disorders. This study investigates the therapeutic potential of p-coumaric acid (p-CA), a natural compound found in vegetables and fruits, against stress-associated mental disorders. The findings suggest that p-CA could alleviate cognitive deficits and depression-like behavior in mice exposed to chronic restraint stress (CRS) by regulating the PKA-CREB-BDNF signaling pathway.
PHYSIOLOGY & BEHAVIOR
(2024)
Article
Psychology, Biological
Mai O. Spaulding, Jessica R. Hoffman, Grace C. Madu, Magen N. Lord, Caroline Soares Iizuka, Kevin P. Myers, Emily E. Noble
Summary: Food insecurity is associated with obesity and disordered eating behaviors. Studying a rodent model, researchers found that adolescent food insecurity may increase susceptibility to obesity and altered eating behaviors during adulthood.
PHYSIOLOGY & BEHAVIOR
(2024)
Article
Psychology, Biological
K. Oberman, B. L. van Leeuwen, M. Nabben, J. E. Villafranca, R. G. Schoemaker
Summary: The present study investigated the post-operative complications and therapeutic potential of J147 in male Zucker rats, and found that J147 treatment had positive effects on behavioral and metabolic parameters, but did not affect neuroinflammation. The results suggest that a combination of acute and chronic J147 treatment may be optimal for treatment.
PHYSIOLOGY & BEHAVIOR
(2024)
Review
Psychology, Biological
Mathieu Cournoyer, Alice Maldera, Alexandre-Charles Gauthier, Fabien Dal Maso, Marie-Eve Mathieu
Summary: This article provides a comprehensive view of the literature on the effect of different odors on physical activity through a systematic review. It was found that pleasant odors have a positive impact on participants' physical activity. However, better methodological consistency is needed in studies to produce more meaningful results.
PHYSIOLOGY & BEHAVIOR
(2024)
Article
Psychology, Biological
Gabriel R. Gilmore, Jeff Dyche
Summary: This study examined sleep, sleep/wake regularity, and cognition in college students diagnosed with depression and using serotonergic antidepressants, comparing them to those without a depression diagnosis. The results showed that students using antidepressants had slightly longer wake after sleep onset and lower sleep efficiency, but these differences were likely not noticed by the participants. There were no differences in sleep regularity or cognition between the two groups.
PHYSIOLOGY & BEHAVIOR
(2024)
Article
Psychology, Biological
Erica A. Cross, Kim L. Huhman, H. Elliott Albers
Summary: Social stress plays a significant role in the development of neuropsychiatric disorders and can lead to behavioral deficits such as social withdrawal. This study investigates the impact of social stress on social reward in Syrian hamsters. The results show that subordinate and socially defeated males have reduced motivation for social interactions compared to dominant males. Additionally, winning males exhibit greater activation in the mesolimbic dopamine system compared to losers. In females, there were no differences in social entries between winners and losers, but winning females display more activation in the NAc shell.
PHYSIOLOGY & BEHAVIOR
(2024)
Article
Psychology, Biological
Daniel A. R. Cabral, Maria L. M. Rego, Eduardo B. Fontes, Vagner D. O. Tavares
Summary: This study examined the association between body mass index (BMI) and negative emotional states (NES) in men with substance use disorders (SUD) undergoing treatment. The findings showed a positive correlation between BMI and stress, anxiety, and depression. These results suggest that reducing body fat accumulation may contribute to improving mental health in individuals with SUD during recovery.
PHYSIOLOGY & BEHAVIOR
(2024)
Review
Psychology, Biological
Elizabeth Agbor Epse Muluh, Jessica C. McCormack, Yunfan Mo, Michael Garratt, Mei Peng
Summary: This PROSPERO pre-registered systematic review and meta-analysis evaluated the olfactory and gustatory changes in pregnant individuals. The meta-analysis revealed that pregnant individuals performed poorer in odour identification, rated olfactory stimuli to be more intense during the second and third trimester, and had increased pleasantness for sweet taste in the first trimester. No major difference was observed in terms of gustatory functions between pregnant and non-pregnant subjects.
PHYSIOLOGY & BEHAVIOR
(2024)
Article
Psychology, Biological
Renee Spiteri Douglas, Mackenzie R. Hartley, J. Renee Yang, Tamara B. Franklin
Summary: The expression of Hdac2 in the hippocampus is associated with social status, while the expression of closely related genes Hdac1 and HDAC2 protein is not associated with social rank in the hippocampus.
PHYSIOLOGY & BEHAVIOR
(2024)