4.6 Article

Robust Match Fusion Using Optimization

Journal

IEEE TRANSACTIONS ON CYBERNETICS
Volume 45, Issue 8, Pages 1549-1560

Publisher

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/TCYB.2014.2355140

Keywords

Exposure fusion; moving scenes; optimization; patch-based match; random walker

Funding

  1. National Basic Research Program of China (973 Program) [2013CB328805]
  2. NSFC-Guangdong Union Foundation [U1035004]
  3. National Natural Science Foundation of China [61272359, 61125106]
  4. Program for New Century Excellent Talents in University [NCET-11-0789]
  5. JSPS KAKENHI [26240015, 26560006]
  6. Chinese Academy of Sciences [KGZD-EW-T03]
  7. Beijing Higher Education Young Elite Teacher Project
  8. Beijing Municipal Education Commission
  9. Grants-in-Aid for Scientific Research [26560006] Funding Source: KAKEN

Ask authors/readers for more resources

In this paper, we present a novel patch-based match and fusion algorithm by taking account of moving scene in a multiple exposure image sequence using optimization. A uniform iterative approach is developed to match and find the corresponding patches in different exposure images, which are then fused in each iteration. Our approach does not need to align the input multiple exposure images before the fusion process. Considering that the pixel values are affected by various exposure time, we design a new patch-based energy function that will be optimized to improve the matching accuracy. An efficient patch-based exposure fusion approach using the random walker algorithm is developed to preserve the moving objects from the input multiple exposure images. To the best of our knowledge, our algorithm is the first patch-based exposure fusion work to preserve the moving objects of dynamic scenes that does not need the registration process of different exposure images. Experimental results of moving scenes demonstrate that our algorithm achieves visually pleasing fusion results without ghosting artifacts, while the results produced by the state-of-the-art exposure fusion and tone mapping algorithms exhibit different levels of ghosting artifacts.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.6
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Automation & Control Systems

Low-Rank 2-D Neighborhood Preserving Projection for Enhanced Robust Image Representation

Yuwu Lu, Zhihui Lai, Xuelong Li, Wai Keung Wong, Chun Yuan, David Zhang

IEEE TRANSACTIONS ON CYBERNETICS (2019)

Article Automation & Control Systems

Multiobject Tracking by Submodular Optimization

Jianbing Shen, Zhiyuan Liang, Jianhong Liu, Hanqiu Sun, Ling Shao, Dacheng Tao

IEEE TRANSACTIONS ON CYBERNETICS (2019)

Article Engineering, Electrical & Electronic

Adaptive Nonlocal Random Walks for Image Superpixel Segmentation

Hui Wang, Jianbing Shen, Junbo Yin, Xingping Dong, Hanqiu Sun, Ling Shao

IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY (2020)

Article Biochemistry & Molecular Biology

Prevention and rescue of cardiac dysfunction by methanocarba adenosine monophosphonate derivatives

Jian-Bing Shen, Kiran S. Toti, Saibal Chakraborty, T. Santhosh Kumar, Chunxia Cronin, Bruce T. Liang, Kenneth A. Jacobson

PURINERGIC SIGNALLING (2020)

Editorial Material Computer Science, Artificial Intelligence

Deep understanding of big geospatial data for self-driving cars

Shuo Shang, Jianbing Shen, Ji-Rong Wen, Panos Kalnis

NEUROCOMPUTING (2021)

Article Ophthalmology

A Retrospective Comparison of Deep Learning to Manual Annotations for Optic Disc and Optic Cup Segmentation in Fundus Photographs

Huazhu Fu, Fei Li, Yanwu Xu, Jingan Liao, Jian Xiong, Jianbing Shen, Jiang Liu, Xiulan Zhang

TRANSLATIONAL VISION SCIENCE & TECHNOLOGY (2020)

Article Computer Science, Artificial Intelligence

Dynamical Hyperparameter Optimization via Deep Reinforcement Learning in Tracking

Xingping Dong, Jianbing Shen, Wenguan Wang, Ling Shao, Haibin Ling, Fatih Porikli

Summary: This paper introduces a novel dynamical hyperparameter optimization method utilizing an action-prediction network based on continuous deep Q-learning, to adaptively optimize hyperparameters for a given sequence and improve visual object tracking performance.

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2021)

Article Optics

Digital holographic deep learning of red blood cells for field-portable, rapid COVID-19 screening

Timothy O'Connor, Jian-Bing Shen, Bruce T. Liang, Bahram Javidi

Summary: This study presents a rapid screening method for COVID-19 infection in red blood cells using a compact, field-portable 3D-printed shearing digital holographic microscope. By analyzing the spatiotemporal behavior of individual red blood cells, a bi-directional long short-term memory network is used to classify between healthy and COVID positive red blood cells. The proposed system may benefit under-resourced healthcare systems.

OPTICS LETTERS (2021)

Article Chemistry, Analytical

One-Stage Anchor-Free 3D Vehicle Detection from LiDAR Sensors

Hao Li, Sanyuan Zhao, Wenjun Zhao, Libin Zhang, Jianbing Shen

Summary: The proposed anchor-free 3D vehicle detection algorithm encodes object positions as keypoints in the bird's-eye view of LiDAR point clouds, mapping them to a single-channel 2D heatmap using voxel/pillar feature extractor and convolutional blocks. The method achieves high average orientation similarity without direction classification tricks, eliminating the need for anchor boxes in target assignment and bounding box decoding processes.

SENSORS (2021)

Article Computer Science, Artificial Intelligence

Zero-Shot Video Object Segmentation With Co-Attention Siamese Networks

Xiankai Lu, Wenguan Wang, Jianbing Shen, David Crandall, Jiebo Luo

Summary: We introduce a novel network called COSNet that addresses the zero-shot video object segmentation task by incorporating a global co-attention mechanism. COSNet outperforms current alternatives by capturing global correlations and scene context through joint computation and appending co-attention responses into a joint feature space.

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2022)

Article Computer Science, Artificial Intelligence

Deep Object Tracking With Shrinkage Loss

Xiankai Lu, Chao Ma, Jianbing Shen, Xiaokang Yang, Ian Reid, Ming-Hsuan Yang

Summary: This paper addresses the problem of data imbalance in learning deep models for visual object tracking. The proposed shrinkage loss function helps balance the training data and improves the performance of both deep regression and classification trackers. Experimental results on six benchmark datasets demonstrate the effectiveness of the shrinkage loss.

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2022)

Article Computer Science, Artificial Intelligence

Siamese Network for RGB-D Salient Object Detection and Beyond

Keren Fu, Deng-Ping Fan, Ge-Peng Ji, Qijun Zhao, Jianbing Shen, Ce Zhu

Summary: This paper proposes a novel RGB-D salient object detection model, which achieves effective feature learning from RGB and depth inputs through joint learning and densely cooperative fusion. Experimental results demonstrate significant improvements over state-of-the-art models on multiple datasets, as well as comparable or better performance on other multi-modal detection tasks and RGB-D semantic segmentation tasks.

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2022)

Article Computer Science, Information Systems

Understanding More About Human and Machine Attention in Deep Neural Networks

Qiuxia Lai, Salman Khan, Yongwei Nie, Hanqiu Sun, Jianbing Shen, Ling Shao

Summary: Both human and machine attention play crucial roles in deep learning models, and understanding the relationship between the two is essential for interpreting and designing neural networks. Recent studies have shown that artificial attention does not always align with human intuition, highlighting the importance of better aligning machine and human attention for improved performance and explainability in neural network design.

IEEE TRANSACTIONS ON MULTIMEDIA (2021)

Article Computer Science, Artificial Intelligence

MSB-FCN: Multi-Scale Bidirectional FCN for Object Skeleton Extraction

Fan Yang, Xin Li, Jianbing Shen

Summary: State-of-the-art object skeleton detection methods leveraging Convolutional Neural Networks have been enhanced by a new architecture called Multi-Scale Bidirectional Fully Convolutional Network (MSB-FCN), which aims to improve the accuracy by better gathering and enhancing multi-scale high-level contextual information. By solely utilizing deep features and a bidirectional structure, along with dense connections and an attention pyramid, MSB-FCN successfully learns semantic-level information and achieves significant improvements over existing algorithms in various benchmarks.

IEEE TRANSACTIONS ON IMAGE PROCESSING (2021)

Proceedings Paper Computer Science, Artificial Intelligence

Efficient Light Deep Network for Street Scene Parsing

ZheHui Wang, Sanyuan Zhao, Jianbing Shen, Zhengchao Lei

2020 IEEE INTERNATIONAL CONFERENCE ON VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP) (2020)

No Data Available