4.6 Article

Solving differential equations using deep neural networks

Journal

NEUROCOMPUTING
Volume 399, Issue -, Pages 193-212

Publisher

ELSEVIER
DOI: 10.1016/j.neucom.2020.02.015

Keywords

Deep neural networks; Differential equations; Partial differential equations; Nonlinear; Shocks; Data analytics; Optimization

Funding

  1. U.S. DOE [DE-FG02-04ER54742]
  2. U.S. DOE Office of Fusion Energy Sciences Scientific Discovery through Advanced Computing (SciDAC) program [DE-SC0018429]
  3. NSF [AST-1413501]
  4. U.S. Department of Energy (DOE) [DE-SC0018429] Funding Source: U.S. Department of Energy (DOE)

Ask authors/readers for more resources

Recent work on solving partial differential equations (PDEs) with deep neural networks (DNNs) is presented. The paper reviews and extends some of these methods while carefully analyzing a fundamental feature in numerical PDEs and nonlinear analysis: irregular solutions. First, the Sod shock tube solution to the compressible Euler equations is discussed and analyzed. This analysis includes a comparison of a DNN-based approach with conventional finite element and finite volume methods, and demonstrates that the DNN is competitive in terms of degrees of freedom required for a given accuracy. Further, the DNNbased approach is extended to consider performance improvements and simultaneous parameter space exploration. Next, a shock solution to compressible magnetohydrodynamics (MHD) is solved for, and used in a scenario where experimental data is utilized to enhance a PDE system that is a priori insufficient to validate against the observed/experimental data. This is accomplished by enriching the model PDE system with source terms that are then inferred via supervised training with synthetic experimental data. The resulting DNN framework for PDEs enables straightforward system prototyping and natural integration of large data sets (be they synthetic or experimental), all while simultaneously enabling single-pass exploration of an entire parameter space. Published by Elsevier B.V.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.6
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Physics, Fluids & Plasmas

A learned closure method applied to phase mixing in a turbulent gradient-driven gyrokinetic system in simple geometry

A. Shukla, D. R. Hatch, W. Dorland, C. Michoski

Summary: A new method for formulating closures that learn from kinetic simulation data is presented and applied to a gyrokinetic turbulent system. The closure, called the learned multi-mode (LMM) closure, is constructed by extracting an optimal basis from a nonlinear kinetic simulation and formulating the closure based on subsequent nonlinear fluid simulations. The effectiveness of the closure is compared with other closure schemes over a broad range of parameter space.

JOURNAL OF PLASMA PHYSICS (2022)

Article Engineering, Mechanical

Experimental and Computational Investigation of Integrated Internal and Film Cooling Designs Incorporating a Thermal Barrier Coating

Matthew J. Horner, Christopher Yoon, Michael Furgeson, Todd A. Oliver, David G. Bogard

Summary: The study demonstrates that enhanced internal cooling can significantly improve overall cooling effectiveness, while the addition of TBC further enhances surface cooling effectiveness on film-cooled components. However, increasing internal cooling techniques and TBC may reduce the benefits provided by the film cooling.

JOURNAL OF TURBOMACHINERY-TRANSACTIONS OF THE ASME (2022)

Article Physics, Fluids & Plasmas

DIII-D research advancing the physics basis for optimizing the tokamak approach to fusion energy

M. E. Fenstermacher, J. Abbate, S. Abe, T. Abrams, M. Adams, B. Adamson, N. Aiba, T. Akiyama, P. Aleynikov, E. Allen, S. Allen, H. Anand, J. Anderson, Y. Andrew, T. Andrews, D. Appelt, R. Arbon, N. Ashikawa, A. Ashourvan, M. Aslin, Y. Asnis, M. Austin, D. Ayala, J. Bak, I Bandyopadhyay, S. Banerjee, K. Barada, L. Bardoczi, J. Barr, E. Bass, D. Battaglia, A. Battey, W. Baumgartner, L. Baylor, J. Beckers, M. Beidler, E. Belli, J. Berkery, T. Bernard, N. Bertelli, M. Beurskens, R. Bielajew, S. Bilgili, B. Biswas, S. Blondel, J. Boedo, I Bogatu, R. Boivin, T. Bolzonella, M. Bongard, X. Bonnin, P. Bonoli, M. Bonotto, A. Bortolon, S. Bose, N. Bosviel, S. Bouwmans, M. Boyer, W. Boyes, L. Bradley, R. Brambila, D. Brennan, S. Bringuier, L. Brodsky, M. Brookman, J. Brooks, D. Brower, G. Brown, W. Brown, M. Burke, K. Burrell, K. Butler, R. Buttery, I Bykov, P. Byrne, A. Cacheris, K. Callahan, J. Callen, G. Campbell, J. Candy, J. Canik, P. Cano-Megias, N. Cao, L. Carayannopoulos, T. Carlstrom, W. Carrig, T. Carter, W. Cary, L. Casali, M. Cengher, G. Cespedes Paz, R. Chaban, V Chan, B. Chapman, I Char, A. Chattopadhyay, R. Chen, J. Chen, X. Chen, X. Chen, J. Chen, M. Chen, J. Chen, Z. Chen, M. Choi, W. Choi, G. Choi, L. Chousal, C. Chrobak, C. Chrystal, Y. Chung, R. Churchill, M. Cianciosa, J. Clark, M. Clement, S. Coda, A. Cole, C. Collins, W. Conlin, A. Cooper, J. Cordell, B. Coriton, T. Cote, J. Cothran, A. Creely, N. Crocker, C. Crowe, B. Crowley, T. Crowley, D. Cruz-Zabala, D. Cummings, M. Curie, D. Curreli, A. Dal Molin, B. Dannels, A. Dautt-Silva, K. Davda, G. De Tommasi, P. De Vries, G. Degrandchamp, J. Degrassie, D. Demers, S. Denk, S. Depasquale, E. Deshazer, A. Diallo, S. Diem, A. Dimits, R. Ding, S. Ding, W. Ding, T. Do, J. Doane, G. Dong, D. Donovan, J. Drake, W. Drews, J. Drobny, X. Du, H. Du, V Duarte, D. Dudt, C. Dunn, J. Duran, A. Dvorak, F. Effenberg, N. Eidietis, D. Elder, D. Eldon, R. Ellis, W. Elwasif, D. Ennis, K. Erickson, D. Ernst, M. Fasciana, D. Fedorov, E. Feibush, N. Ferraro, J. Ferreira, J. Ferron, P. Fimognari, D. Finkenthal, R. Fitzpatrick, P. Fox, W. Fox, L. Frassinetti, H. Frerichs, H. Frye, Y. Fu, K. Gage, J. Galdon Quiroga, A. Gallo, Q. Gao, A. Garcia, M. Garcia Munoz, D. Garnier, A. Garofalo, A. Gattuso, D. Geng, K. Gentle, D. Ghosh, L. Giacomelli, S. Gibson, E. Gilson, C. Giroud, F. Glass, A. Glasser, D. Glibert, P. Gohil, R. Gomez, S. Gomez, X. Gong, E. Gonzales, A. Goodman, Y. Gorelov, V Graber, R. Granetz, T. Gray, D. Green, C. Greenfield, M. Greenwald, B. Grierson, R. Groebner, W. Grosnickle, M. Groth, H. Grunloh, S. Gu, W. Guo, H. Guo, P. Gupta, J. Guterl, W. Guttenfelder, T. Guzman, S. Haar, R. Hager, S. Hahn, M. Halfmoon, T. Hall, K. Hallatschek, F. Halpern, G. Hammett, H. Han, E. Hansen, C. Hansen, M. Hansink, J. Hanson, M. Hanson, G. Hao, A. Harris, R. Harvey, S. Haskey, E. Hassan, A. Hassanein, D. Hatch, R. Hawryluk, W. Hayashi, W. Heidbrink, J. Herfindal, J. Hicok, D. Hill, E. Hinson, C. Holcomb, L. Holland, C. Holland, E. Hollmann, J. Hollocombe, A. Holm, I Holmes, K. Holtrop, M. Honda, R. Hong, R. Hood, A. Horton, L. Horvath, M. Hosokawa, S. Houshmandyar, N. Howard, E. Howell, D. Hoyt, W. Hu, Y. Hu, Q. Hu, J. Huang, Y. Huang, J. Hughes, T. Human, D. Humphreys, P. Huynh, A. Hyatt, C. Ibanez, L. Ibarra, R. Icasas, K. Ida, V Igochine, Y. In, S. Inoue, A. Isayama, O. Izacard, V Izzo, A. Jackson, G. Jacobsen, A. Jaervinen, A. Jalalvand, J. Janhunen, S. Jardin, H. Jarleblad, Y. Jeon, H. Ji, X. Jian, E. Joffrin, A. Johansen, C. Johnson, T. Johnson, C. Jones, I Joseph, D. Jubas, B. Junge, W. Kalb, R. Kalling, C. Kamath, J. Kang, D. Kaplan, A. Kaptanoglu, S. Kasdorf, J. Kates-Harbeck, P. Kazantzidis, A. Kellman, D. Kellman, C. Kessel, K. Khumthong, E. Kim, H. Kim, J. Kim, S. Kim, J. Kim, H. Kim, K. Kim, C. Kim, W. Kimura, M. King, J. King, J. Kinsey, A. Kirk, B. Kiyan, A. Kleiner, V Klevarova, R. Knapp, M. Knolker, W. Ko, T. Kobayashi, E. Koch, M. Kochan, B. Koel, M. Koepke, A. Kohn, R. Kolasinski, E. Kolemen, E. Kostadinova, M. Kostuk, G. Kramer, D. Kriete, L. Kripner, S. Kubota, J. Kulchar, K. Kwon, R. La Haye, F. Laggner, H. Lan, R. Lantsov, L. Lao, A. Lasa Esquisabel, C. Lasnier, C. Lau, B. Leard, J. Lee, R. Lee, M. Lee, M. Lee, Y. Lee, C. Lee, J. Lee, S. Lee, M. Lehnen, A. Leonard, E. Leppink, M. Lesher, J. Lestz, J. Leuer, N. Leuthold, X. Li, K. Li, E. Li, G. Li, L. Li, Z. Li, J. Li, Y. Li, Z. Lin, D. Lin, X. Liu, J. Liu, Y. Liu, T. Liu, Y. Liu, C. Liu, Z. Liu, C. Liu, D. Liu, A. Liu, D. Liu, A. Loarte-Prieto, L. Lodestro, N. Logan, J. Lohr, B. Lombardo, J. Lore, Q. Luan, T. Luce, T. Luda Di Cortemiglia, N. Luhmann, R. Lunsford, Z. Luo, A. Lvovskiy, B. Lyons, X. Ma, M. Madruga, B. Madsen, C. Maggi, K. Maheshwari, A. Mail, J. Mailloux, R. Maingi, M. Major, M. Makowski, R. Manchanda, C. Marini, A. Marinoni, A. Maris, T. Markovic, L. Marrelli, E. Martin, J. Mateja, G. Matsunaga, R. Maurizio, P. Mauzey, D. Mauzey, G. Mcardle, J. Mcclenaghan, K. Mccollam, C. Mcdevitt, K. Mckay, G. Mckee, A. Mclean, V Mehta, E. Meier, J. Menard, O. Meneghini, G. Merlo, S. Messer, W. Meyer, C. Michael, C. Michoski, P. Milne, G. Minet, A. Misleh, Y. Mitrishkin, C. Moeller, K. Montes, M. Morales, S. Mordijck, D. Moreau, S. Morosohk, P. Morris, L. Morton, A. Moser, R. Moyer, C. Moynihan, T. Mrazkova, D. Mueller, S. Munaretto, J. Munoz Burgos, C. Murphy, K. Murphy, C. Muscatello, C. Myers, A. Nagy, G. Nandipati, M. Navarro, F. Nave, G. Navratil, R. Nazikian, A. Neff, G. Neilson, T. Neiser, W. Neiswanger, D. Nelson, A. Nelson, F. Nespoli, R. Nguyen, L. Nguyen, X. Nguyen, J. Nichols, M. Nocente, S. Nogami, S. Noraky, N. Norausky, M. Nornberg, R. Nygren, T. Odstrcil, D. Ogas, T. Ogorman, S. Ohdachi, Y. Ohtani, M. Okabayashi, M. Okamoto, L. Olavson, E. Olofsson, M. Omullane, R. Oneill, D. Orlov, W. Orvis, T. Osborne, D. Pace, G. Paganini Canal, A. Pajares Martinez, L. Palacios, C. Pan, Q. Pan, R. Pandit, M. Pandya, A. Pankin, Y. Park, J. Park, J. Park, S. Parker, P. Parks, M. Parsons, B. Patel, C. Pawley, C. Paz-Soldan, W. Peebles, S. Pelton, R. Perillo, C. Petty, Y. Peysson, D. Pierce, A. Pigarov, L. Pigatto, D. Piglowski, S. Pinches, R. Pinsker, P. Piovesan, N. Piper, A. Pironti, R. Pitts, J. Pizzo, U. Plank, M. Podesta, E. Poli, F. Poli, D. Ponce, Z. Popovic, M. Porkolab, G. Porter, C. Powers, S. Powers, R. Prater, Q. Pratt, I Pusztai, J. Qian, X. Qin, O. Ra, T. Rafiq, T. Raines, R. Raman, J. Rauch, A. Raymond, C. Rea, M. Reich, A. Reiman, S. Reinhold, M. Reinke, R. Reksoatmodjo, Q. Ren, Y. Ren, J. Ren, M. Rensink, J. Renteria, T. Rhodes, J. Rice, R. Roberts, J. Robinson, P. Rodriguez Fernandez, T. Rognlien, A. Rosenthal, S. Rosiello, J. Rost, J. Roveto, W. Rowan, R. Rozenblat, J. Ruane, D. Rudakov, J. Ruiz Ruiz, R. Rupani, S. Saarelma, S. Sabbagh, J. Sachdev, J. Saenz, S. Saib, M. Salewski, A. Salmi, B. Sammuli, C. Samuell, A. Sandorfi, C. Sang, J. Sarff, O. Sauter, K. Schaubel, L. Schmitz, O. Schmitz, J. Schneider, P. Schroeder, K. Schultz, E. Schuster, J. Schwartz, F. Sciortino, F. Scotti, J. Scoville, A. Seltzman, S. Seol, I Sfiligoi, M. Shafer, S. Sharapov, H. Shen, Z. Sheng, T. Shepard, S. Shi, Y. Shibata, G. Shin, D. Shiraki, R. Shousha, H. Si, P. Simmerling, G. Sinclair, J. Sinha, P. Sinha, G. Sips, T. Sizyuk, C. Skinner, A. Sladkomedova, T. Slendebroek, J. Slief, R. Smirnov, J. Smith, S. Smith, D. Smith, J. Snipes, G. Snoep, A. Snyder, P. Snyder, E. Solano, W. Solomon, J. Song, A. Sontag, V Soukhanovskii, J. Spendlove, D. Spong, J. Squire, C. Srinivasan, W. Stacey, G. Staebler, L. Stagner, T. Stange, P. Stangeby, R. Stefan, R. Stemprok, D. Stephan, J. Stillerman, T. Stoltzfus-Dueck, W. Stonecipher, S. Storment, E. Strait, D. Su, L. Sugiyama, Y. Sun, P. Sun, Z. Sun, A. Sun, D. Sundstrom, C. Sung, J. Sungcoco, W. Suttrop, Y. Suzuki, T. Suzuki, A. Svyatkovskiy, C. Swee, R. Sweeney, C. Sweetnam, G. Szepesi, M. Takechi, T. Tala, K. Tanaka, X. Tang, S. Tang, Y. Tao, R. Tao, D. Taussig, T. Taylor, K. Teixeira, K. Teo, A. Theodorsen, D. Thomas, K. Thome, A. Thorman, A. Thornton, A. Ti, M. Tillack, N. Timchenko, R. Tinguely, R. Tompkins, J. Tooker, A. Torrezan De Sousa, G. Trevisan, S. Tripathi, A. Trujillo Ochoa, D. Truong, C. Tsui, F. Turco, A. Turnbull, M. Umansky, E. Unterberg, P. Vaezi, P. Vail, J. Valdez, W. Valkis, B. Van Compernolle, J. Van Galen, R. Van Kampen, M. Van Zeeland, G. Verdoolaege, N. Vianello, B. Victor, E. Viezzer, S. Vincena, M. Wade, F. Waelbroeck, J. Wai, T. Wakatsuki, M. Walker, G. Wallace, R. Waltz, W. Wampler, L. Wang, H. Wang, Y. Wang, H. Wang, Z. Wang, H. Wang, Z. Wang, Y. Wang, G. Wang, S. Ward, M. Watkins, J. Watkins, W. Wehner, Y. Wei, M. Weiland, D. Weisberg, A. Welander, A. White, R. White, S. Wiesen, R. Wilcox, T. Wilks, M. Willensdorfer, H. Wilson, A. Wingen, M. Wolde, M. Wolff, K. Woller, A. Wolz, H. Wong, S. Woodruff, M. Wu, Y. Wu, S. Wukitch, G. Wurden, W. Xiao, R. Xie, Z. Xing, X. Xu, C. Xu, G. Xu, Z. Yan, X. Yang, S. Yang, T. Yokoyama, R. Yoneda, M. Yoshida, K. You, T. Younkin, J. Yu, M. Yu, G. Yu, Q. Yuan, L. Zaidenberg, L. Zakharov, A. Zamengo, S. Zamperini, M. Zarnstorff, E. Zeger, K. Zeller, L. Zeng, M. Zerbini, L. Zhang, X. Zhang, R. Zhang, B. Zhang, J. Zhang, J. Zhang, L. Zhao, B. Zhao, Y. Zheng, L. Zheng, B. Zhu, J. Zhu, Y. Zhu, Y. Zhu, M. Zsutty, M. Zuin

Summary: DIII-D physics research addresses critical challenges for the operation of ITER and the next generation of fusion energy devices by focusing on innovations for high performance long pulse operation and fundamental plasma physics understanding. The research has led to substantial improvements in off-axis current drive efficiency and Alfven eigenmode control, as well as validated models for pedestal recovery after ELMs and disruption mitigation techniques. The findings provide confidence in optimizing future tokamak operation and handling disruptivity.

NUCLEAR FUSION (2022)

Article Physics, Fluids & Plasmas

Reduced models for ETG transport in the tokamak pedestal

D. R. Hatch, C. Michoski, D. Kuang, B. Chapman-Oplopoiou, M. Curie, M. Halfmoon, E. Hassan, M. Kotschenreuther, S. M. Mahajan, G. Merlo, M. J. Pueschel, J. Walker, C. D. Stephens

Summary: This paper reports on the development of reduced models for electron temperature gradient (ETG) driven transport in the pedestal. The models were developed using a set of nonlinear gyrokinetic simulations, and a new database for gyrokinetic simulation data was created to facilitate analysis. The models achieved accurate predictions with low errors.

PHYSICS OF PLASMAS (2022)

Article Engineering, Biomedical

SEER-net: Simple EEG-based Recognition network

Dongyang Kuang, Craig Michoski

Summary: This paper presents a Simple ElectroEncephalographic-based Recognition Network (SEER-net) that directly uses normalized EEG signals as input for end-to-end classification tasks. SEER-net utilizes a forked design with tailored kernels in each fork to operate along different directions on extracted features. It achieves comparable classification accuracy to state-of-the-art networks while utilizing significantly fewer parameters. The experiments demonstrate SEER-net's effectiveness in subject-dependent emotion classification tasks, achieving 90.73% mean test accuracy with only 3485 parameters on the SEED dataset. Ablation studies are conducted to evaluate the impact of variations in the SEER-net's architecture, and visualization techniques are employed to gain deeper physical insight and human-relatable interpretations.

BIOMEDICAL SIGNAL PROCESSING AND CONTROL (2023)

Article Green & Sustainable Science & Technology

COVID-19 and Behavioral Factors of e-Payment Use: Evidence from Serbia

Milos Milosavljevic, Milan Okanovic, Slavica Cicvaric Kostic, Marija Jovanovic, Milenko Radonic

Summary: The aim of this article is to examine the influence of pandemic-specific factors on the use of e-payment, using Serbia as an example. The study is based on primary data gathered through a questionnaire, and the results confirm that variables such as hand sanitization, conspiracy mentality, and financial acumen significantly predict the use of e-payment.

SUSTAINABILITY (2023)

Article Economics

What drives the performance of tax administrations? Evidence from selected european countries

Milos Milosavljevic, Sandro Radovanovic, Boris Delibasic

Summary: An effective, efficient, fair, and trusted tax administration is crucial for every country, but it faces various challenges such as corruption and lack of flexibility. This study analyzed 35 European tax administrations and identified digitalization as the most influential driver of tax administration performance. Nordic countries and Switzerland serve as role models, and the country-level results can reflect the shadow economy. These findings provide guidance for policymakers in improving tax administration performance.

ECONOMIC MODELLING (2023)

Review Business, Finance

Bibliometric Review of Participatory Budgeting: Current Status and Future Research Agenda

Milos Milosavljevic, Zeljko Spasenic, Jovan Krivokapic

Summary: Participatory budgeting has been advocated as an important tool for democratic innovation and has received significant scholarly attention in recent years. This bibliometric review demonstrates that research on participatory budgeting has reached its peak of interest before the COVID-19 pandemic and has expanded to various fields apart from political science.

INTERNATIONAL JOURNAL OF FINANCIAL STUDIES (2023)

Review Oncology

Incidental finding of synchronous neuroendocrine tumor of appendix and rectal adenocarcinoma. A case report and literature review

Aleksandar Lazovic, Milica Dimitrijevic Stojanovic, Milos Milosavljevic, Vesna Stankovic, Bojan Milosevic, Bojana S. Stojanovic, Marko Spasic, Aleksandar Cvetkovic, Bojan Stojanovic

Summary: This case report describes an incidental neuroendocrine tumor of the appendix discovered during surgery for rectal adenocarcinoma and provides a review of the relevant literature. The small appendiceal mass measuring 0.4 cm in diameter was excised during the operation and histopathological examination confirmed a well-differentiated NET of the appendix. The report underscores the importance of thorough intraoperative examination during colorectal surgeries and highlights the need for increased awareness of appendiceal NETs among surgeons.

ONCOLOGIE (2023)

Proceedings Paper Computer Science, Interdisciplinary Applications

Bibliometric Survey on Microfinance for the SMEE Sector

Milos Milosavljevic, Zeljko Spasenic, Vesna Damnjanovic

Summary: Limited access to credits by SMEEs is a major barrier for their development and economic growth. MFIs are considered a viable alternative for financing SMEEs. This paper collects evidence on the importance of MFIs for SMEEs' access to finance and concludes that the research in this area has reached saturation, providing sufficient knowledge for policymakers to establish an effective microfinance system.

SUSTAINABLE BUSINESS MANAGEMENT AND DIGITAL TRANSFORMATION: CHALLENGES AND OPPORTUNITIES IN THE POST-COVID ERA (2023)

Proceedings Paper Computer Science, Artificial Intelligence

KAM - A Kernel Attention Module for Emotion Classification with EEG Data

Dongyang Kuang, Craig Michoski

Summary: This work presents a kernel attention module for EEG-based emotion classification, which utilizes a self-attention mechanism and requires fewer parameters and computations. The module improves the classification performance and allows for better interpretation of the trained model.

INTERPRETABILITY OF MACHINE INTELLIGENCE IN MEDICAL IMAGE COMPUTING, IMIMIC 2022 (2022)

Proceedings Paper Computer Science, Artificial Intelligence

A Monotonicity Constrained Attention Module for Emotion Classification with Limited EEG Data

Dongyang Kuang, Craig Michoski, Wenting Li, Rui Guo

Summary: In this study, a parameter-efficient attention module for emotion classification using a limited number of EEG signals is proposed. Experimental results show that this module is comparable to state-of-the-art modules in improving prediction performance while requiring fewer parameters. Sensitivity analyses on trained models regarding different attacks are also conducted.

MEDICAL IMAGE LEARNING WITH LIMITED AND NOISY DATA (MILLAND 2022) (2022)

Article Environmental Sciences

PROJECT FINANCING OF RENEWABLE ENERGY PROJECTS A BIBLIOMETRIC ANALYSIS AND FUTURE RESEARCH AGENDA

Zeljko Spasenic, Milos Milosavljevic, Nemanja Milanovic

Summary: This paper uses bibliometric analysis to explore the scholarly output, geographical distribution, and sub-areas of project financing of renewable energy projects. The results show a growing interest in this topic among scholars and provide potential directions for future research.

FRESENIUS ENVIRONMENTAL BULLETIN (2022)

Proceedings Paper Business

Drivers of e-Relational Capital in the Retail Industry

Valentina Vukmirovic, Milenko Radonic, Milos Milosavljevic

Summary: This study examines the electronic form of relational capital in fast-moving consumer goods retailers in Serbia and its respective drivers. The results indicate that customer loyalty and brand awareness play a significant role in the customers' side of e-relational capital, while supplier trust and relationship performance are crucial in the suppliers' side.

MARKETING AND SMART TECHNOLOGIES, ICMARKTECH 2021, VOL 2 (2022)

Article Education & Educational Research

Antecedents of University Entrepreneurship: Empirical Evidence from Serbian Public Universities

Sladjana Benkovic, Milos Milosavljevic, Zeljko Spasenic, Aleksandra Jovanovic

Summary: This study aims to investigate the effects of individual entrepreneurial orientation on entrepreneurial outcomes in Serbian higher education institutions, examining factors such as research mobilization, unconventionality, industry collaboration, and university policies. The results suggest that entrepreneurial orientation plays a significant role in commercial research outcomes.

CROATIAN JOURNAL OF EDUCATION-HRVATSKI CASOPIS ZA ODGOJ I OBRAZOVANJE (2022)

Article Computer Science, Artificial Intelligence

3D-KCPNet: Efficient 3DCNNs based on tensor mapping theory

Rui Lv, Dingheng Wang, Jiangbin Zheng, Zhao-Xu Yang

Summary: In this paper, the authors investigate tensor decomposition for neural network compression. They analyze the convergence and precision of tensor mapping theory, validate the rationality of tensor mapping and its superiority over traditional tensor approximation based on the Lottery Ticket Hypothesis. They propose an efficient method called 3D-KCPNet to compress 3D convolutional neural networks using the Kronecker canonical polyadic (KCP) tensor decomposition. Experimental results show that 3D-KCPNet achieves higher accuracy compared to the original baseline model and the corresponding tensor approximation model.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

Personalized robotic control via constrained multi-objective reinforcement learning

Xiangkun He, Zhongxu Hu, Haohan Yang, Chen Lv

Summary: In this paper, a novel constrained multi-objective reinforcement learning algorithm is proposed for personalized end-to-end robotic control with continuous actions. The approach trains a single model using constraint design and a comprehensive index to achieve optimal policies based on user-specified preferences.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

Overlapping community detection using expansion with contraction

Zhijian Zhuo, Bilian Chen, Shenbao Yu, Langcai Cao

Summary: In this paper, a novel method called Expansion with Contraction Method for Overlapping Community Detection (ECOCD) is proposed, which utilizes non-negative matrix factorization to obtain disjoint communities and applies expansion and contraction processes to adjust the degree of overlap. ECOCD is applicable to various networks with different properties and achieves high-quality overlapping community detection.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

High-compressed deepfake video detection with contrastive spatiotemporal distillation

Yizhe Zhu, Chunhui Zhang, Jialin Gao, Xin Sun, Zihan Rui, Xi Zhou

Summary: In this work, the authors propose a Contrastive Spatio-Temporal Distilling (CSTD) approach to improve the detection of high-compressed deepfake videos. The approach leverages spatial-frequency cues and temporal-contrastive alignment to fully exploit spatiotemporal inconsistency information.

NEUROCOMPUTING (2024)

Review Computer Science, Artificial Intelligence

A review of coverless steganography

Laijin Meng, Xinghao Jiang, Tanfeng Sun

Summary: This paper provides a review of coverless steganographic algorithms, including the development process, known contributions, and general issues in image and video algorithms. It also discusses the security of coverless steganography from theoretical analysis to actual investigation for the first time.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

Confidence-based interactable neural-symbolic visual question answering

Yajie Bao, Tianwei Xing, Xun Chen

Summary: Visual question answering requires processing multi-modal information and effective reasoning. Neural-symbolic learning is a promising method, but current approaches lack uncertainty handling and can only provide a single answer. To address this, we propose a confidence based neural-symbolic approach that evaluates NN inferences and conducts reasoning based on confidence.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

A framework-based transformer and knowledge distillation for interior style classification

Anh H. Vo, Bao T. Nguyen

Summary: Interior style classification is an interesting problem with potential applications in both commercial and academic domains. This project proposes a method named ISC-DeIT, which combines data-efficient image transformer architectures and knowledge distillation, to address the interior style classification problem. Experimental results demonstrate a significant improvement in predictive accuracy compared to other state-of-the-art methods.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

Improving robustness for vision transformer with a simple dynamic scanning augmentation

Shashank Kotyan, Danilo Vasconcellos Vargas

Summary: This article introduces a novel augmentation technique called Dynamic Scanning Augmentation to improve the accuracy and robustness of Vision Transformer (ViT). The technique leverages dynamic input sequences to adaptively focus on different patches, resulting in significant changes in ViT's attention mechanism. Experimental results demonstrate that Dynamic Scanning Augmentation outperforms ViT in terms of both robustness to adversarial attacks and accuracy against natural images.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

Introducing shape priors in Siamese networks for image classification

Hiba Alqasir, Damien Muselet, Christophe Ducottet

Summary: The article proposes a solution to improve the learning process of a classification network by providing shape priors, reducing the need for annotated data. The solution is tested on cross-domain digit classification tasks and a video surveillance application.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

Neural dynamics solver for time-dependent infinity-norm optimization based on ACP framework with robot application

Dexiu Ma, Mei Liu, Mingsheng Shang

Summary: This paper proposes a method using neural dynamics solvers to solve infinity-norm optimization problems. Two improved solvers are constructed and their effectiveness and superiority are demonstrated through theoretical analysis and simulation experiments.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

cpp-AIF: A multi-core C plus plus implementation of Active Inference for Partially Observable Markov Decision Processes

Francesco Gregoretti, Giovanni Pezzulo, Domenico Maisto

Summary: Active Inference is a computational framework that uses probabilistic inference and variational free energy minimization to describe perception, planning, and action. cpp-AIF is a header-only C++ library that provides a powerful tool for implementing Active Inference for Partially Observable Markov Decision Processes through multi-core computing. It is cross-platform and improves performance, memory management, and usability compared to existing software.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

Predicting stock market trends with self-supervised learning

Zelin Ying, Dawei Cheng, Cen Chen, Xiang Li, Peng Zhu, Yifeng Luo, Yuqi Liang

Summary: This paper proposes a novel stock market trends prediction framework called SMART, which includes a self-supervised stock technical data sequence embedding model S3E. By training with multiple self-supervised auxiliary tasks, the model encodes stock technical data sequences into embeddings and uses the learned sequence embeddings for predicting stock market trends. Extensive experiments on China A-Shares market and NASDAQ market prove the high effectiveness of our model in stock market trends prediction, and its effectiveness is further validated in real-world applications in a leading financial service provider in China.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

DHGAT: Hyperbolic representation learning on dynamic graphs via attention networks

Hao Li, Hao Jiang, Dongsheng Ye, Qiang Wang, Liang Du, Yuanyuan Zeng, Liu Yuan, Yingxue Wang, C. Chen

Summary: DHGAT1, a dynamic hyperbolic graph attention network, utilizes hyperbolic metric properties to embed dynamic graphs. It employs a spatiotemporal self-attention mechanism and weighted node representations, resulting in excellent performance in link prediction tasks.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

Progressive network based on detail scaling and texture extraction: A more general framework for image deraining

Jiehui Huang, Zhenchao Tang, Xuedong He, Jun Zhou, Defeng Zhou, Calvin Yu-Chian Chen

Summary: This study proposes a progressive learning multi-scale feature blending model for image deraining tasks. The model utilizes detail dilation and texture extraction to improve the restoration of rainy images. Experimental results show that the model achieves near state-of-the-art performance in rain removal tasks and exhibits better rain removal realism.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

Stabilization and synchronization control for discrete-time complex networks via the auxiliary role of edges subsystem

Lizhi Liu, Zilin Gao, Yinhe Wang, Yongfu Li

Summary: This paper proposes a novel discrete-time interconnected model for depicting complex dynamical networks. The model consists of nodes and edges subsystems, which consider the dynamic characteristic of both nodes and edges. By designing control strategies and coupling modes, the stabilization and synchronization of the network are achieved. Simulation results demonstrate the effectiveness of the proposed methods.

NEUROCOMPUTING (2024)