4.6 Article

Depth-Aware Image Seam Carving

Journal

IEEE TRANSACTIONS ON CYBERNETICS
Volume 43, Issue 5, Pages 1453-1461

Publisher

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/TCYB.2013.2273270

Keywords

Energy optimization; image retargeting; Kinect depth camera; saliency; seam carving

Funding

  1. National Basic Research Program of China (973 Program) [2013CB328805]
  2. NSFC-Guangdong Union Foundation [U1035004]
  3. National Natural Science Foundation of China [61125106, 61272359, 61072093]
  4. Program for New Century Excellent Talents in University [NCET-11-0789]
  5. Shaanxi Key Innovation Team of Science and Technology [2012KCT-04]

Ask authors/readers for more resources

Image seam carving algorithm should preserve important and salient objects as much as possible when changing the image size, while not removing the secondary objects in the scene. However, it is still difficult to determine the important and salient objects that avoid the distortion of these objects after resizing the input image. In this paper, we develop a novel depth-aware single image seam carving approach by taking advantage of the modern depth cameras such as the Kinect sensor, which captures the RGB color image and its corresponding depth map simultaneously. By considering both the depth information and the just noticeable difference (JND) model, we develop an efficient JND-based significant computation approach using the multiscale graph cut based energy optimization. Our method achieves the better seam carving performance by cutting the near objects less seams while removing distant objects more seams. To the best of our knowledge, our algorithm is the first work to use the true depth map captured by Kinect depth camera for single image seam carving. The experimental results demonstrate that the proposed approach produces better seam carving results than previous content-aware seam carving methods.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.6
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Engineering, Electrical & Electronic

Structurally Incoherent Low-Rank 2DLPP for Image Classification

Yuwu Lu, Chun Yuan, Xuelong Li, Zhihui Lai, David Zhang, Linlin Shen

IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY (2019)

Article Automation & Control Systems

Stereo Video Object Segmentation Using Stereoscopic Foreground Trajectories

Chang Liu, Wenguan Wang, Jianbing Shen, Ling Shao

IEEE TRANSACTIONS ON CYBERNETICS (2019)

Article Engineering, Electrical & Electronic

Adaptive Nonlocal Random Walks for Image Superpixel Segmentation

Hui Wang, Jianbing Shen, Junbo Yin, Xingping Dong, Hanqiu Sun, Ling Shao

IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY (2020)

Article Biochemistry & Molecular Biology

Prevention and rescue of cardiac dysfunction by methanocarba adenosine monophosphonate derivatives

Jian-Bing Shen, Kiran S. Toti, Saibal Chakraborty, T. Santhosh Kumar, Chunxia Cronin, Bruce T. Liang, Kenneth A. Jacobson

PURINERGIC SIGNALLING (2020)

Editorial Material Computer Science, Artificial Intelligence

Deep understanding of big geospatial data for self-driving cars

Shuo Shang, Jianbing Shen, Ji-Rong Wen, Panos Kalnis

NEUROCOMPUTING (2021)

Article Ophthalmology

A Retrospective Comparison of Deep Learning to Manual Annotations for Optic Disc and Optic Cup Segmentation in Fundus Photographs

Huazhu Fu, Fei Li, Yanwu Xu, Jingan Liao, Jian Xiong, Jianbing Shen, Jiang Liu, Xiulan Zhang

TRANSLATIONAL VISION SCIENCE & TECHNOLOGY (2020)

Article Computer Science, Artificial Intelligence

Dynamical Hyperparameter Optimization via Deep Reinforcement Learning in Tracking

Xingping Dong, Jianbing Shen, Wenguan Wang, Ling Shao, Haibin Ling, Fatih Porikli

Summary: This paper introduces a novel dynamical hyperparameter optimization method utilizing an action-prediction network based on continuous deep Q-learning, to adaptively optimize hyperparameters for a given sequence and improve visual object tracking performance.

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2021)

Article Optics

Digital holographic deep learning of red blood cells for field-portable, rapid COVID-19 screening

Timothy O'Connor, Jian-Bing Shen, Bruce T. Liang, Bahram Javidi

Summary: This study presents a rapid screening method for COVID-19 infection in red blood cells using a compact, field-portable 3D-printed shearing digital holographic microscope. By analyzing the spatiotemporal behavior of individual red blood cells, a bi-directional long short-term memory network is used to classify between healthy and COVID positive red blood cells. The proposed system may benefit under-resourced healthcare systems.

OPTICS LETTERS (2021)

Article Chemistry, Analytical

One-Stage Anchor-Free 3D Vehicle Detection from LiDAR Sensors

Hao Li, Sanyuan Zhao, Wenjun Zhao, Libin Zhang, Jianbing Shen

Summary: The proposed anchor-free 3D vehicle detection algorithm encodes object positions as keypoints in the bird's-eye view of LiDAR point clouds, mapping them to a single-channel 2D heatmap using voxel/pillar feature extractor and convolutional blocks. The method achieves high average orientation similarity without direction classification tricks, eliminating the need for anchor boxes in target assignment and bounding box decoding processes.

SENSORS (2021)

Article Computer Science, Artificial Intelligence

Zero-Shot Video Object Segmentation With Co-Attention Siamese Networks

Xiankai Lu, Wenguan Wang, Jianbing Shen, David Crandall, Jiebo Luo

Summary: We introduce a novel network called COSNet that addresses the zero-shot video object segmentation task by incorporating a global co-attention mechanism. COSNet outperforms current alternatives by capturing global correlations and scene context through joint computation and appending co-attention responses into a joint feature space.

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2022)

Article Computer Science, Artificial Intelligence

Deep Object Tracking With Shrinkage Loss

Xiankai Lu, Chao Ma, Jianbing Shen, Xiaokang Yang, Ian Reid, Ming-Hsuan Yang

Summary: This paper addresses the problem of data imbalance in learning deep models for visual object tracking. The proposed shrinkage loss function helps balance the training data and improves the performance of both deep regression and classification trackers. Experimental results on six benchmark datasets demonstrate the effectiveness of the shrinkage loss.

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2022)

Article Computer Science, Artificial Intelligence

Siamese Network for RGB-D Salient Object Detection and Beyond

Keren Fu, Deng-Ping Fan, Ge-Peng Ji, Qijun Zhao, Jianbing Shen, Ce Zhu

Summary: This paper proposes a novel RGB-D salient object detection model, which achieves effective feature learning from RGB and depth inputs through joint learning and densely cooperative fusion. Experimental results demonstrate significant improvements over state-of-the-art models on multiple datasets, as well as comparable or better performance on other multi-modal detection tasks and RGB-D semantic segmentation tasks.

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2022)

Article Computer Science, Information Systems

Understanding More About Human and Machine Attention in Deep Neural Networks

Qiuxia Lai, Salman Khan, Yongwei Nie, Hanqiu Sun, Jianbing Shen, Ling Shao

Summary: Both human and machine attention play crucial roles in deep learning models, and understanding the relationship between the two is essential for interpreting and designing neural networks. Recent studies have shown that artificial attention does not always align with human intuition, highlighting the importance of better aligning machine and human attention for improved performance and explainability in neural network design.

IEEE TRANSACTIONS ON MULTIMEDIA (2021)

Article Computer Science, Artificial Intelligence

MSB-FCN: Multi-Scale Bidirectional FCN for Object Skeleton Extraction

Fan Yang, Xin Li, Jianbing Shen

Summary: State-of-the-art object skeleton detection methods leveraging Convolutional Neural Networks have been enhanced by a new architecture called Multi-Scale Bidirectional Fully Convolutional Network (MSB-FCN), which aims to improve the accuracy by better gathering and enhancing multi-scale high-level contextual information. By solely utilizing deep features and a bidirectional structure, along with dense connections and an attention pyramid, MSB-FCN successfully learns semantic-level information and achieves significant improvements over existing algorithms in various benchmarks.

IEEE TRANSACTIONS ON IMAGE PROCESSING (2021)

Proceedings Paper Computer Science, Artificial Intelligence

Efficient Light Deep Network for Street Scene Parsing

ZheHui Wang, Sanyuan Zhao, Jianbing Shen, Zhengchao Lei

2020 IEEE INTERNATIONAL CONFERENCE ON VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP) (2020)

No Data Available