4.7 Review

Multiple-scale stochastic processes: Decimation, averaging and beyond

Journal

Publisher

ELSEVIER
DOI: 10.1016/j.physrep.2016.12.003

Keywords

Markov processes; Diffusive processes; Multiscale methods; Irreversibility; Stochastic functionals

Ask authors/readers for more resources

The recent experimental progresses in handling microscopic systems have allowed to probe them at levels where fluctuations are prominent, calling for stochastic modeling in a large number of physical, chemical and biological phenomena. This has provided fruitful applications for established stochastic methods and motivated further developments. These systems often involve processes taking place on widely separated time scales. For an efficient modeling one usually focuses on the slower degrees of freedom and it is of great importance to accurately eliminate the fast variables in a controlled fashion, carefully accounting for their net effect on the slower dynamics. This procedure in general requires to perform two different operations: decimation and coarse-graining. We introduce the asymptotic methods that form the basis of this procedure and discuss their application to a series of physical, biological and chemical examples. We then turn our attention to functionals of the stochastic trajectories such as residence times, counting statistics, fluxes, entropy production, etc. which have been increasingly studied in recent years. For such functionals, the elimination of the fast degrees of freedom can present additional difficulties and naive procedures can lead to blatantly inconsistent results. Homogenization techniques for functionals are less covered in the literature and we will pedagogically present them here, as natural extensions of the ones employed for the trajectories. We will also discuss recent applications of these techniques to the thermodynamics of small systems and their interpretation in terms of information-theoretic concepts. (C) 2016 Elsevier B.V. All rights reserved.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.7
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Biology

Generosity, selfishness and exploitation as optimal greedy strategies for resource sharing

Andrea Mazzolini, Antonio Celani

JOURNAL OF THEORETICAL BIOLOGY (2020)

Article Multidisciplinary Sciences

Power-law population heterogeneity governs epidemic waves

Jonas Neipel, Jonathan Bauermann, Stefano Bo, Tyler Harmon, Frank Juelicher

PLOS ONE (2020)

Article Mechanics

How irreversible are steady-state trajectories of a trapped active particle?

Lennart Dabelow, Stefano Bo, Ralf Eichhorn

Summary: The defining feature of active particles is their constant self-propulsion through the conversion of chemical energy into directed motion, keeping them permanently out of equilibrium. Despite potentially sharing certain equilibrium features, active particles may break the time-reversal symmetry in anharmonic potentials while fulfilling it in harmonic potentials in steady-state trajectories.

JOURNAL OF STATISTICAL MECHANICS-THEORY AND EXPERIMENT (2021)

Article Physics, Multidisciplinary

Classification, inference and segmentation of anomalous diffusion with recurrent neural networks

Aykut Argun, Giovanni Volpe, Stefano Bo

Summary: This study introduces a data-driven method called RANDI, which utilizes recurrent neural networks to analyze single anomalous diffusion trajectories, successfully inferring the anomalous exponent and identifying the mechanisms responsible for anomalous diffusion. Our method has proven to be the most versatile, consistently ranking in the top 3 for all tasks in the Anomalous Diffusion challenge.

JOURNAL OF PHYSICS A-MATHEMATICAL AND THEORETICAL (2021)

Article Mechanics

Optimal collision avoidance in swarms of active Brownian particles

Francesco Borra, Massimo Cencini, Antonio Celani

Summary: The effectiveness of collective navigation of biological or artificial agents must address the conflicting requirements of staying in a group while avoiding close encounters and limiting energy expenditure. Research shows that optimized multiple objectives can explain observed group behaviors and provide a theoretical basis for biomimetic algorithms used by artificial agents.

JOURNAL OF STATISTICAL MECHANICS-THEORY AND EXPERIMENT (2021)

Article Multidisciplinary Sciences

Objective comparison of methods to decode anomalous diffusion

Gorka Munoz-Gil, Giovanni Volpe, Miguel Angel Garcia-March, Erez Aghion, Aykut Argun, Chang Beom Hong, Tom Bland, Stefano Bo, J. Alberto Conejero, Nicolas Firbas, Oscar Orts, Alessia Gentili, Zihan Huang, Jae-Hyung Jeon, Helene Kabbech, Yeongjin Kim, Patrycja Kowalek, Diego Krapf, Hanna Loch-Olszewska, Michael A. Lomholt, Jean-Baptiste Masson, Philipp G. Meyer, Seongyu Park, Borja Requena, Ihor Smal, Taegeun Song, Janusz Szwabinski, Samudrajit Thapa, Hippolyte Verdier, Giorgio Volpe, Artur Widera, Maciej Lewenstein, Ralf Metzler, Carlo Manzo

Summary: Deviations from Brownian motion leading to anomalous diffusion are commonly found in transport dynamics, but challenging to characterize. An open competition comparing different approaches for single trajectory analysis showed that machine learning methods outperform classical approaches.

NATURE COMMUNICATIONS (2021)

Article Biology

Quantitative theory for the diffusive dynamics of liquid condensates

Lars Hubatsch, Louise M. Jawerth, Celina Love, Jonathan Bauermann, Ty Dora Tang, Stefano Bo, Anthony A. Hyman, Christoph A. Weber

Summary: This study establishes a physics-based dynamic equation framework that accurately determines diffusion coefficients within liquid condensates and validates the framework's performance through experiments. The research demonstrates that this method can be applied to protein condensates and polyelectrolyte-coacervate systems, showing very accurate and precise results.

ELIFE (2021)

Article Physics, Fluids & Plasmas

Reinforcement learning for pursuit and evasion of microswimmers at low Reynolds number

Francesco Borra, Luca Biferale, Massimo Cencini, Antonio Celani

Summary: This study focuses on a model of two competing microswimming agents engaged in a pursue-evasion task within a low-Reynolds-number environment. The agents, with limited maneuverability and partial information about the opponent's position and motion, are trained using adversarial reinforcement learning to overcome partial observability and discover increasingly complex sequences of moves.

PHYSICAL REVIEW FLUIDS (2022)

Article Physics, Multidisciplinary

Sticky Issues in Turbulent Transport

Antonio Celani, Gautam Reddy, Massimo Vergassola

Summary: This study investigates the role of partial stickiness on turbulent transport among particles or with a surface. The results show that enforcing the constraints of orthogonality and normalization leads to previously obtained results in a more intuitive way. Additionally, a general model of transport within the atmospheric boundary layer is introduced, and the study demonstrates the existence of acceptable boundary conditions within certain parameter ranges.

ANNALES HENRI POINCARE (2022)

Article Chemistry, Physical

Optimizing airborne wind energy with reinforcement learning

N. Orzan, C. Leone, A. Mazzolini, J. Oyero, A. Celani

Summary: Airborne wind energy is a lightweight technology that utilizes airborne devices like kites and gliders to extract power from the wind. Conventional methods are unable to optimize the control of these devices due to the dynamical complexity of turbulent aerodynamics. In this study, we propose to use reinforcement learning to solve this problem, which allows the system to learn an optimal strategy through trial-and-error interactions with the environment. Our simulation results demonstrate that reinforcement learning can effectively control a kite to tow a vehicle for long distances, and the algorithm's physically transparent interpretation allows for a simple list of maneuvering instructions to describe the approximately optimal strategy.

EUROPEAN PHYSICAL JOURNAL E (2023)

Article Chemistry, Physical

Taming Lagrangian chaos with multi-objective reinforcement learning

Chiara Calascibetta, Luca Biferale, Francesco Borra, Antonio Celani, Massimo Cencini

Summary: This study tackles the problem of optimizing both the dispersion rate and control activation cost for two active particles in 2D complex flows using multi-objective reinforcement learning (MORL) with variable swimming velocity. The combination of scalarization techniques and Q-learning algorithm enables MORL to find an optimal Pareto frontier and outperform heuristic strategies as benchmarks. Moreover, the authors investigate the impact of decision time on the performance of the reinforcement learning strategies, highlighting the need for enhanced knowledge of the flow for longer decision times.

EUROPEAN PHYSICAL JOURNAL E (2023)

Article Biochemistry & Molecular Biology

Seeking and sharing information in collective olfactory search

Emanuele Panizon, Antonio Celani

Summary: Searching for a target is a fundamental task for many living organisms, and long-distance search guided by olfactory cues is a typical example. Research shows that sharing information among individuals can significantly decrease search times, even without explicit coordination.

PHYSICAL BIOLOGY (2023)

Article Physics, Fluids & Plasmas

Optimal policies for Bayesian olfactory search in turbulent flows

R. A. Heinonen, L. Biferale, A. Celani, M. Vergassola

Summary: In many practical scenarios, flying insects face the challenge of searching for emitted cues in turbulent environments. In this study, a partially observable Markov decision process is used to model this search problem, and the Perseus algorithm is employed to compute near-optimal strategies for minimizing arrival time. The computed strategies outperform several heuristic strategies and provide insights into the search difficulty and robustness in different environmental conditions.

PHYSICAL REVIEW E (2023)

Article Physics, Fluids & Plasmas

Passive odd viscoelasticity

Ruben Lier, Jay Armas, Stefano Bo, Charlie Duclut, Frank Juelicher, Piotr Surowka

Summary: This study demonstrates the existence of odd elasticity in viscoelastic materials, which is present not only in active systems but also in passive chiral viscoelastic fluids. Linear viscoelastic chiral solids require activity to exhibit odd elastic responses.

PHYSICAL REVIEW E (2022)

Article Physics, Multidisciplinary

Stochastic dynamics of single molecules across phase boundaries

Stefano Bo, Lars Hubatsch, Jonathan Bauermann, Christoph A. Weber, Frank Juelicher

Summary: This study discusses the stochastic trajectories of single molecules in a phase-separated liquid with coexisting dense and dilute phases. The research shows that molecular trajectories can be described as diffusion with drift in an effective potential. Furthermore, it explores how the physics of phase coexistence affects the statistics of molecular trajectories, particularly in relation to displacements of molecules crossing phase boundaries.

PHYSICAL REVIEW RESEARCH (2021)

Review Physics, Multidisciplinary

Physics of the analytic S-matrix

Sebastian Mizera

Summary: This article discusses the mathematical properties and physical implications of scattering amplitudes, and traces these properties back to physics through simple scattering problems.

PHYSICS REPORTS-REVIEW SECTION OF PHYSICS LETTERS (2024)