4.5 Article

Predictive coding and the slowness principle: An information-theoretic approach

期刊

NEURAL COMPUTATION
卷 20, 期 4, 页码 1026-1041

出版社

MIT PRESS
DOI: 10.1162/neco.2008.01-07-455

关键词

-

向作者/读者索取更多资源

Understanding the guiding principles of sensory coding strategies is a main goal in computational neuroscience. Among others, the principles of predictive coding and slowness appear to capture aspects of sensory processing. Predictive coding postulates that sensory systems are adapted to the structure of their input signals such that information about future inputs is encoded. Slow feature analysis (SFA) is a method for extracting slowly varying components from quickly varying input signals, thereby learning temporally invariant features. Here, we use the information bottleneck method to state an information-theoretic objective function for temporally local predictive coding. We then show that the linear case of SFA can be interpreted as a variant of predictive coding that maximizes the mutual information between the current output of the system and the input signal in the next time step. This demonstrates that the slowness principle and predictive coding are intimately related.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.5
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

Article Environmental Sciences

Demand-side solutions to climate change mitigation consistent with high levels of well-being

Felix Creutzig, Leila Niamir, Xuemei Bai, Max Callaghan, Jonathan Cullen, Julio Diaz-Jose, Maria Figueroa, Arnulf Grubler, William F. Lamb, Adrian Leip, Eric Masanet, Erika Mata, Linus Mattauch, Jan C. Minx, Sebastian Mirasgedis, Yacob Mulugetta, Sudarmanto Budi Nugroho, Minal Pathak, Patricia Perkins, Joyashree Roy, Stephane de la Rue du Can, Yamina Saheb, Shreya Some, Linda Steg, Julia Steinberger, Diana Urge-Vorsatz

Summary: The study highlights the significant potential of demand-side measures in mitigating greenhouse gas emissions and improving human well-being outcomes, with largely positive effects.

NATURE CLIMATE CHANGE (2022)

Article Biochemical Research Methods

Optimizing interneuron circuits for compartment-specific feedback inhibition

Joram J. Keijser, Henning Sprekeler

Summary: The brain's cortical circuits process information through recurrent interactions between excitatory neurons and inhibitory interneurons. This study investigates the specificity of inhibitory feedback in stabilizing the circuit by enabling separate feedback control loops for different synaptic input streams. Using an optimization approach, the researchers found that the resulting circuit can be seen as a neural decoder that reverses the nonlinear biophysical computations within pyramidal cells. This study provides a proof of concept for understanding the structure-function relationships in cortical circuits.

PLOS COMPUTATIONAL BIOLOGY (2022)

Article Biology

Invariant neural subspaces maintained by feedback modulation

Laura B. Naumann, Joram Keijser, Henning Sprekeler

Summary: This study investigates the establishment of context-invariant representations through feedback processing. The results show that feedback-modulated feedforward neural networks can dynamically generate invariant sensory representations, rather than on the level of individual neurons. This invariance is achieved by dynamically reorienting the manifold of neural activity and maintaining an invariant neural subspace at the population level.
Article Environmental Sciences

Aligning artificial intelligence with climate change mitigation

Lynn H. Kaack, Priya L. Donti, Emma Strubell, George Kamiya, Felix Creutzig, David Rolnick

Summary: This article presents a framework to assess the impact of artificial intelligence on greenhouse gas emissions and suggests approaches to mitigate its effects on climate change.

NATURE CLIMATE CHANGE (2022)

Article Green & Sustainable Science & Technology

Choosing a Mode in Bangkok: Room for Shared Mobility?

Eva Ayaragarnchanakul, Felix Creutzig, Aneeque Javaid, Nattapong Puttanapong

Summary: Individual motorized vehicles in urban environments are oversupplied and inefficient, but shared mobility offers a more efficient use of vehicles. Commuters value time and fuel costs, but dislike walking, waiting, and searching for parking. Shared taxis have the potential to be used as a door-to-door mode of transportation.

SUSTAINABILITY (2022)

Review Energy & Fuels

Pandemic, War, and Global Energy Transitions

Behnam Zakeri, Katsia Paulavets, Leonardo Barreto-Gomez, Luis Gomez Echeverri, Shonali Pachauri, Benigna Boza-Kiss, Caroline Zimm, Joeri Rogelj, Felix Creutzig, Diana Uerge-Vorsatz, David G. Victor, Morgan D. Bazilian, Steffen Fritz, Dolf Gielen, David L. McCollum, Leena Srivastava, Julian D. Hunt, Shaheen Pouya

Summary: The COVID-19 pandemic and Russia's war on Ukraine have had a negative impact on the global energy industry, causing fluctuations in energy demand, disruptions in energy supply chains, and hindering energy investments. However, these crises also presented opportunities for low-carbon energy transitions, which may have been missed due to short-term policy focus on supporting the fossil fuel industry.

ENERGIES (2022)

Article Environmental Sciences

Carbon emissions and economic impacts of an EU embargo on Russian fossil fuels

Li-Jing Liu, Hong-Dian Jiang, Qiao-Mei Liang, Felix Creutzig, Hua Liao, Yun-Fei Yao, Xiang-Yan Qian, Zhong-Yuan Ren, Jing Qing, Qi-Ran Cai, Ottmar Edenhofer, Yi-Ming Wei

Summary: The Russia-Ukraine conflict exposes the EU's reliance on fossil fuel imports from Russia. Using a global computable general equilibrium model, this study examines the impact of embargoing Russian fossil fuels on CO2 emissions and GDP. The findings show that embargoes would result in a more than 10% reduction in CO2 emissions in the EU and slight increases in Russia, but both regions would experience GDP losses. Implementing demand-side response within the EU could increase CO2 emission savings and mitigate GDP losses.

NATURE CLIMATE CHANGE (2023)

Article Environmental Studies

Agent-based modeling to integrate elements from different disciplines for ambitious climate policy

Ivan Savin, Felix Creutzig, Tatiana Filatova, Joel Foramitti, Theo Konc, Leila Niamir, Karolina Safarzynska, Jeroen van den Bergh

Summary: Ambitious climate mitigation policies face resistance due to social and political factors, partly because they fail to incorporate diverse insights from the social sciences regarding potential policy outcomes. Agent-based models can serve as a powerful tool for integrating elements from different disciplines, enabling a more comprehensive assessment of climate policies.

WILEY INTERDISCIPLINARY REVIEWS-CLIMATE CHANGE (2023)

Article Green & Sustainable Science & Technology

Environmental and welfare gains via urban transport policy portfolios across 120 cities

Charlotte Liotta, Vincent Viguie, Felix Creutzig

Summary: This study uses a spatially explicit monocentric urban economic model to analyze the impact of four representative policies on reducing transport greenhouse gas emissions in 120 cities worldwide. The results show that implementing these policies in all cities can reduce transportation greenhouse gas emissions by 31% in 15 years. However, the consequences of the same policies vary widely between cities, depending on factors such as the policy considered, income level, population growth rate, spatial organization, and existing public transport supply. Applying welfare-increasing policy portfolios can reduce emissions by 22% in 15 years.

NATURE SUSTAINABILITY (2023)

Article Environmental Studies

Contribution of carbon pricing to meeting a mid-century net zero target

Erik Haites, Paolo Bertoldi, Michael Koenig, Christopher Bataille, Felix Creutzig, Dipak Dasgupta, Stephane de la Rue du Can, Smail Khennas, Yong-Gun Kim, Lars J. Nilsson, Joyashree Roy, Agus Sari

Summary: This paper highlights the challenge of reducing emissions in emissions-intensive, trade-exposed sectors and proposes policy packages to achieve emission reduction targets while minimizing the risk of leakage.

CLIMATE POLICY (2023)

Article Environmental Sciences

Designing a virtuous cycle: Quality of governance, effective climate change mitigation, and just outcomes support each other

Felix Creutzig, Frank Goetzke, Anjali Ramakrishnan, Marina Andrijevic, Patricia Perkins

Summary: Climate change mitigation is often evaluated based on technologies and policy instruments, but the role of governance and social capital in complex social systems should not be overlooked. This study explores the importance of quality of governance, social capital, and equality as prerequisites for effective climate policies. By analyzing national-level indicators of social systems with Qualitative Comparative Analysis (QCA) and Structural Equation Models (SEM), we find that impartiality in governance is crucial for fostering social capital, interpersonal trust, equality, and effective climate policies such as carbon pricing. Socio-economic inequalities can undermine trust and political engagement, posing challenges to achieving the overarching goal of climate change mitigation. However, evidence suggests that fairly implemented climate policies can contribute to a virtuous cycle by improving the quality of governance and strengthening the capacity to implement strong climate policies. Our findings highlight the significance of impartial governance and social capital in driving effective climate policies.

GLOBAL ENVIRONMENTAL CHANGE-HUMAN AND POLICY DIMENSIONS (2023)

Article Multidisciplinary Sciences

Built structures influence patterns of energy demand and CO2 emissions across countries

Helmut Haberl, Markus Loew, Alejandro Perez-Laborda, Sarah Matej, Barbara Plank, Dominik Wiedenhofer, Felix Creutzig, Karl-Heinz Erb, Juan Antonio Duro

Summary: The extent and spatial patterns of settlements and infrastructures have a significant impact on the resource demand of national economies worldwide, almost as much as GDP. While built structures at the urban level are known to influence energy demand and CO2 emissions, their role at the national level is often overlooked due to limited data availability. Instead, factors such as GDP are more commonly assessed. In this study, we present national-level indicators to characterize patterns of built structures and find that they are almost equally important as GDP for predicting energy demand and CO2 emissions.

NATURE COMMUNICATIONS (2023)

Article Green & Sustainable Science & Technology

Shifting urban mobility patterns due to COVID-19: comparative analysis of implemented urban policies and travel behaviour changes with an assessment of overall GHG emissions implications

Felix Creutzig, Steffen Lohrey, Mercedes Vazquez Franza

Summary: COVID-19-induced confinements have significantly changed human behavior and social norms in street spaces worldwide. This study examines the shifting urban mobility during the confinement period and in response to COVID-19 physical distancing policies. The analysis shows that public transit decreased by 80% during confinement, while individual motorized transport decreased by 64%. Some cities experienced an increase in cycling modal share. COVID-19 and sustainability are closely linked, particularly in terms of health, gender equality, sustainable cities, and climate action. The study reveals both positive and negative outcomes of the confinement, including reduced congestion and improved air quality, but also unhealthy eating habits and domestic violence. Cities around the world have taken measures to provide more space for cyclists and pedestrians, such as pedestrianizing streets and implementing temporary bicycle infrastructure. The findings suggest that increased uptake of cycling has resulted in greenhouse gas emission reductions, with cities with pop-up bicycle lanes achieving greater savings.

ENVIRONMENTAL RESEARCH: INFRASTRUCTURE AND SUSTAINABILITY (2022)

Review Green & Sustainable Science & Technology

A systematic review on shared mobility in China

Jia-Wei Hu, Felix Creutzig

Summary: This study systematically reviews the current state of shared mobility in China, analyzing the factors shaping shared mobility patterns from the perspectives of consumers, service providers, the government, and the environment. It also discusses governance measures guiding shared mobility and investigates the impact of shared mobility on a potential low-carbon transportation system transition.

INTERNATIONAL JOURNAL OF SUSTAINABLE TRANSPORTATION (2022)

暂无数据