4.7 Article

A new wavelet-based denoising algorithm for high-frequency financial data mining

Journal

EUROPEAN JOURNAL OF OPERATIONAL RESEARCH
Volume 217, Issue 3, Pages 589-599

Publisher

ELSEVIER SCIENCE BV
DOI: 10.1016/j.ejor.2011.09.049

Keywords

Time series; Data mining; Denoising; High-frequency financial data; Wavelets

Funding

  1. Karlsruhe House of Young Scientists (KHYS)
  2. German Ministry of Education and Research (BMBF)

Ask authors/readers for more resources

Denoising analysis imposes new challenge for mining high-frequency financial data due to its irregularities and roughness. Inefficient decomposition of the systematic pattern (the trend) and noises of high-frequency data will lead to erroneous conclusion as the irregularities and roughness of the data make the application of traditional methods difficult. In this paper, we propose the local linear scaling approximation (in short, LLSA) algorithm, a new nonlinear filtering algorithm based on the linear maximal overlap discrete wavelet transform (MODWT) to decompose the systematic pattern and noises. We show several unique properties of this brand-new algorithm, that are, the local linearity, computational complexity, and consistency. We conduct a simulation study to confirm these properties we have analytically shown and compare the performance of LLSA with MODWT. We then apply our new algorithm with the real high-frequency data from German equity market to investigate its implementation in forecasting. We show the superior performance of LLSA and conclude that it can be applied with flexible settings and suitable for high-frequency data mining. (C) 2011 Elsevier B.V. All rights reserved.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.7
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Operations Research & Management Science

Coherent quality management for big data systems: a dynamic approach for stochastic time consistency

Yi-Ting Chen, Edward W. Sun, Yi-Bing Lin

ANNALS OF OPERATIONS RESEARCH (2019)

Article Operations Research & Management Science

Stylized algorithmic trading: satisfying the predictive near-term demand of liquidity

Edward W. Sun, Timm Kruse, Yi-Ting Chen

ANNALS OF OPERATIONS RESEARCH (2019)

Article Economics

Jump Detection and Noise Separation by a Singular Wavelet Method for Predictive Analytics of High-Frequency Data

Yi-Ting Chen, Wan-Ni Lai, Edward W. Sun

COMPUTATIONAL ECONOMICS (2019)

Article Operations Research & Management Science

Comonotonicity and low volatility effect

Wan-Ni Lai, Yi-Ting Chen, Edward W. Sun

Summary: The low volatility effect does not always mean low volatility stocks outperform high volatility stocks; in fact, this effect is mainly driven by high volatility stocks with high specific risks. By decomposing volatility into its individual risk components, it is found that volatility increases monotonically with its specific risk component. Returns obtained from the low volatility effect in stocks are primarily driven by the specific risk component rather than the systematic risk component.

ANNALS OF OPERATIONS RESEARCH (2021)

Article Economics

Machine learning with parallel neural networks for analyzing and forecasting electricity demand

Yi-Ting Chen, Edward W. Sun, Yi-Bing Lin

COMPUTATIONAL ECONOMICS (2020)

Article Engineering, Industrial

Behavioral data-driven analysis with Bayesian method for risk management of financial services

Edward M. H. Lin, Edward W. Sun, Min-Teh Yu

INTERNATIONAL JOURNAL OF PRODUCTION ECONOMICS (2020)

Article Engineering, Industrial

Pragmatic real-time logistics management with traffic IoT infrastructure: Big data predictive analytics of freight travel time for Logistics 4.0

Yi-Ting Chen, Edward W. Sun, Ming-Feng Chang, Yi-Bing Lin

Summary: The determination of travel time is crucial for logistics companies to optimize their operations, especially for on-time arrivals in the vehicle routing problem. The Traffic Internet of Things (IoT) utilizes data from various sources to analyze real-time traffic status, increasing logistics efficiency for Logistics 4.0. However, the complexity of big IoT data poses challenges in determining travel time in real-time basis. This research proposes a novel method to forecast travel time based on industrial IoT data, successfully enhancing predictive accuracy after empirical comparison with other computational methods.

INTERNATIONAL JOURNAL OF PRODUCTION ECONOMICS (2021)

Article Physics, Multidisciplinary

Mixed-Stable Models: An Application to High-Frequency Financial Data

Igoris Belovas, Leonidas Sakalauskas, Vadimas Starikovicius, Edward W. Sun

Summary: This paper extends the application of mixed-stable models to the analysis of financial data, using the German DAX stock index as a case study for 29 companies. The study proposes the smart-Delta method for calculating the probability density function, with the obtained parameter estimates being used for constructing optimal asset portfolios. The impact of accuracy in computing the probability density function and ML optimization on modeling results and processing time is also examined.

ENTROPY (2021)

Article Management

Optimal decision of dynamic wealth allocation with life insurance for mitigating health risk under market incompleteness

Chang-Chih Chen, Chia-Chien Chang, Edward W. Sun, Min-Teh Yu

Summary: This research presents a dynamic control model for income allocation in the presence of market incompleteness. The study finds that the incompleteness of the life insurance market is due to the non-tradability of health status, and the impact of market incompleteness on life insurance demand is highly influenced by health status characteristics.

EUROPEAN JOURNAL OF OPERATIONAL RESEARCH (2022)

Article Operations Research & Management Science

Risk factor extraction with quantile regression method

Wan-Ni Lai, Claire Y. T. Chen, Edward W. Sun

Summary: This study uses quantile regressions to determine the optimal quantiles for extracting firm characteristic based risk factors. By examining 23 developed countries, it is found that the optimal quantiles used to construct common factors may differ between factors, but are similar across the North American, Asia-Pacific, and Europe regions.

ANNALS OF OPERATIONS RESEARCH (2022)

Article Economics

Classifying the Variety of Customers' Online Engagement for Churn Prediction with a Mixed-Penalty Logistic Regression

Petra P. Simovic, Claire Y. T. Chen, Edward W. Sun

Summary: Using big data to analyze consumer behavior provides effective decision-making tools for preventing customer attrition in CRM. This research proposes a new predictive analytics based on machine learning, enhancing the classification of logistic regression by adding a penalty term. It addresses overfitting and cost balance in big data analysis.

COMPUTATIONAL ECONOMICS (2023)

Article Operations Research & Management Science

Enhancing travel time prediction with deep learning on chronological and retrospective time order information of big traffic data

Claire Y. T. Chen, Edward W. Sun, Ming-Feng Chang, Yi-Bing Lin

Summary: With the increasing environmental concerns and the utilization of big data, smart transportation is transforming logistics business and operations towards a more sustainable approach. This paper presents a new deep learning approach called bi-directional isometric-gated recurrent unit (BDIGRU) for predictive analysis of travel time and business adoption for route planning. The proposed method directly learns high-level features from big traffic data and reconstructs them using its own attention mechanism, achieving significant improvements in predictive accuracy and efficient route determination under uncertainty.

ANNALS OF OPERATIONS RESEARCH (2023)

Article Economics

Integrated Portfolio Risk Measure: Estimation and Asymptotics of Multivariate Geometric Quantiles

Edward W. Sun, Yu-Jen Wang, Min-Teh Yu

COMPUTATIONAL ECONOMICS (2018)

Article Economics

Risk Assessment with Wavelet Feature Engineering for High-Frequency Portfolio Trading

Yi-Ting Chen, Edward W. Sun, Min-Teh Yu

COMPUTATIONAL ECONOMICS (2018)

Review Management

Survey of optimization models for power system operation and expansion planning with demand response

Vinicius N. Motta, Miguel F. Anjos, Michel Gendreau

Summary: This survey presents a review of optimization approaches for the integration of demand response in power systems planning and highlights important future research directions.

EUROPEAN JOURNAL OF OPERATIONAL RESEARCH (2024)

Article Management

R-SALSA: A branch, bound, and remember algorithm for the workload smoothing problem on simple assembly lines

Philipp Schulze, Armin Scholl, Rico Walter

Summary: This paper proposes an improved branch-and-bound algorithm, R-SALSA, for solving the simple assembly line balancing problem, which performs well in balancing workloads and providing initial solutions.

EUROPEAN JOURNAL OF OPERATIONAL RESEARCH (2024)

Article Management

Adaptive scheduling in service systems: A Dynamic programming approach

Roshan Mahes, Michel Mandjes, Marko Boon, Peter Taylor

Summary: This paper discusses appointment scheduling and presents a phase-type-based approach to handle variations in service times. Numerical experiments with dynamic scheduling demonstrate the benefits of rescheduling.

EUROPEAN JOURNAL OF OPERATIONAL RESEARCH (2024)

Article Management

Discrete scheduling and critical utilization

Oleg S. Pianykh, Sebastian Perez, Chengzhao Richard Zhang

Summary: Efficient scheduling is crucial for optimizing resource allocation and system performance. This study focuses on critical utilization and efficient scheduling in discrete scheduling systems, and compares the results with classical queueing theory.

EUROPEAN JOURNAL OF OPERATIONAL RESEARCH (2024)

Review Management

Supply chain network design with financial considerations: A comprehensive review

Hamed Jahani, Babak Abbasi, Jiuh-Biing Sheu, Walid Klibi

Summary: Supply chain network design is a large and growing area of research. This study comprehensively surveys and analyzes articles published from 2008 to 2021 to detect and report financial perspectives in SCND models. The study also identifies research gaps and offers future research directions.

EUROPEAN JOURNAL OF OPERATIONAL RESEARCH (2024)

Article Management

A branch-and-cut algorithm for the connected max- k-cut problem

Patrick Healy, Nicolas Jozefowiez, Pierre Laroche, Franc Marchetti, Sebastien Martin, Zsuzsanna Roka

Summary: The Connected Max-k-Cut Problem is an extension of the well-known Max-Cut Problem, where the objective is to partition a graph into k connected subgraphs by maximizing the cost of inter-partition edges. The researchers propose a new integer linear program and a branch-and-cut algorithm for this problem, and also use graph isomorphism to structure the instances and facilitate their resolution. Extensive computational experiments show that, if k > 2, their approach outperforms existing algorithms in terms of quality.

EUROPEAN JOURNAL OF OPERATIONAL RESEARCH (2024)

Article Management

Estimating production functions through additive models based on regression splines

Victor J. Espana, Juan Aparicio, Xavier Barber, Miriam Esteve

Summary: This paper introduces a new methodology based on the machine learning technique MARS for estimating production functions that satisfy classical production theory axioms. The new approach overcomes the overfitting problem of DEA through generalized cross-validation and demonstrates better performance in reducing mean squared error and bias compared to DEA and C2NLS methods.

EUROPEAN JOURNAL OF OPERATIONAL RESEARCH (2024)

Article Management

Time-flexible min completion time variance in a single machine by quadratic programming

Stefano Nasini, Rabia Nessah

Summary: In this paper, the authors investigate the impact of time flexibility in job scheduling, showing that it can significantly affect operators' ability to solve the problem efficiently. They propose a new methodology based on convex quadratic programming approaches that allows for optimal solutions in large-scale instances.

EUROPEAN JOURNAL OF OPERATIONAL RESEARCH (2024)

Article Management

Convex support vector regression

Zhiqiang Liao, Sheng Dai, Timo Kuosmanen

Summary: Nonparametric regression subject to convexity or concavity constraints is gaining popularity in various fields. The conventional convex regression method often suffers from overfitting and outliers. This paper proposes the convex support vector regression method to address these issues and demonstrates its advantages in prediction accuracy and robustness through numerical experiments.

EUROPEAN JOURNAL OF OPERATIONAL RESEARCH (2024)

Article Management

A simulation evacuation framework for effective disaster preparedness strategies and response decision making

Kuo-Hao Chang, Ying-Zheng Wu, Wen-Ray Su, Lee-Yaw Lin

Summary: The damage and destruction caused by earthquakes necessitates the evacuation of affected populations. Simulation models, such as the Stochastic Pedestrian Cell Transmission Model (SPCTM), can be utilized to enhance disaster and evacuation management. The analysis of SPCTM provides insights for government officials to formulate effective evacuation strategies.

EUROPEAN JOURNAL OF OPERATIONAL RESEARCH (2024)

Article Management

An effective hybrid evolutionary algorithm for the clustered orienteering problem

Qinghua Wu, Mu He, Jin-Kao Hao, Yongliang Lu

Summary: This paper studies a variant of the orienteering problem known as the clustered orienteering problem. In this problem, customers are grouped into clusters and a profit is associated with each cluster, collected only when all customers in the cluster are served. The proposed evolutionary algorithm, incorporating a backbone-based crossover operator and a destroy-and-repair mutation operator, outperforms existing algorithms on benchmark instances and sets new records on some instances. It also demonstrates scalability on large instances and has shown superiority over three state-of-the-art COP algorithms. The algorithm is also successfully applied to a dynamic version of the COP considering stochastic travel time.

EUROPEAN JOURNAL OF OPERATIONAL RESEARCH (2024)

Article Management

Improving uplift model evaluation on randomized controlled trial data

Bjorn Bokelmann, Stefan Lessmann

Summary: Estimating treatment effects is an important task for data analysts, and uplift models provide support for efficient allocation of treatments. However, evaluating uplift models is challenging due to variance issues. This paper theoretically analyzes the variance of uplift evaluation metrics, proposes variance reduction methods based on statistical adjustment, and demonstrates their benefits on simulated and real-world data.

EUROPEAN JOURNAL OF OPERATIONAL RESEARCH (2024)

Article Management

Newsvendor conditional value-at-risk minimisation: A feature-based approach under adaptive data selection

Congzheng Liu, Wenqi Zhu

Summary: This paper proposes a feature-based non-parametric approach to minimizing the conditional value-at-risk in the newsvendor problem. The method is able to handle both linear and nonlinear profits without prior knowledge of the demand distribution. Results from numerical and real-life experiments demonstrate the robustness and effectiveness of the approach.

EUROPEAN JOURNAL OF OPERATIONAL RESEARCH (2024)

Article Management

Right-left asymmetry of the eigenvector method: A simulation study

Laszlo Csato

Summary: This paper compares the performance of the eigenvalue method and the row geometric mean as two weighting procedures. Through numerical experiments, it is found that the priorities derived from the two eigenvectors in the eigenvalue method do not always agree, while the row geometric mean serves as a compromise between them.

EUROPEAN JOURNAL OF OPERATIONAL RESEARCH (2024)

Article Management

Compete or cooperate? Effects of channel relationships on government policies for sustainability

Guowei Dou, Tsan-Ming Choi

Summary: This study investigates the impact of channel relationships between manufacturers on government policies and explores the effectiveness of positive incentives versus taxes in increasing social welfare. The findings suggest that competition may be more effective in improving sustainability and social welfare. Additionally, government incentives for green technology may not necessarily enhance sustainability.

EUROPEAN JOURNAL OF OPERATIONAL RESEARCH (2024)