4.7 Article

Shape and Refractive Index from Single-View Spectro-Polarimetric Images

Journal

INTERNATIONAL JOURNAL OF COMPUTER VISION
Volume 101, Issue 1, Pages 64-94

Publisher

SPRINGER
DOI: 10.1007/s11263-012-0546-3

Keywords

Polarisation; Shape recovery; Refractive index; Spectro-polarimetric imagery; Multispectral imagery; Hyperspectral imagery; Fresnel reflection; Dispersion equations

Funding

  1. Australian Government
  2. Digital Economy
  3. Australian Research Council through the ICT Centre of Excellence program

Ask authors/readers for more resources

In this paper, we address the problem of the simultaneous recovery of the shape and refractive index of an object from a spectro-polarimetric image captured from a single view. Here, we focus on the diffuse polarisation process occuring at dielectric surfaces due to subsurface scattering and transmission from the object surface into the air. The diffuse polarisation of the reflection process is modelled by the Fresnel transmission theory. We present a method for estimating the azimuth angle of surface normals from the spectral variation of the phase of polarisation. Moreover, we estimate the zenith angle of surface normals and index of refraction simultaneously in a well-posed optimisation framework. We achieve well-posedness by introducing two additional constraints to the problem, including the surface integrability and the material dispersion equation. This yields an iterative solution which is computationally efficient due to the use of closed-form solutions for both the zenith angle and the refractive index in each iteration. To demonstrate the effectiveness of our approach, we show results of shape recovery and surface rendering for both real-world and synthetic imagery.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.7
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Computer Science, Artificial Intelligence

Learning Backtrackless Aligned-Spatial Graph Convolutional Networks for Graph Classification

Lu Bai, Lixin Cui, Yuhang Jiao, Luca Rossi, Edwin R. Hancock

Summary: In this paper, a novel backtrackless aligned-spatial graph convolutional network (BASGCN) model is proposed for learning effective features for graph classification. This model addresses the issues of information loss and imprecise information representation in existing spatially-based graph convolutional network (GCN) models, and bridges the theoretical gap between traditional convolutional neural network (CNN) models and spatially-based GCN models. Experimental results demonstrate the effectiveness of the proposed model.

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2022)

Article Computer Science, Artificial Intelligence

Two-Level Graph Neural Network

Xing Ai, Chengyu Sun, Zhihong Zhang, Edwin R. Hancock

Summary: The study proposes a novel GNN framework called TL-GNN, which combines subgraph-level information with node-level information to enrich the features captured by GNNs. The study also provides a mathematical analysis of the LPI problem and proposes a subgraph counting method based on the dynamic programming algorithm.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2022)

Article Computer Science, Artificial Intelligence

Uncertainty estimation for stereo matching based on evidential deep learning

Chen Wang, Xiang Wang, Jiawei Zhang, Liang Zhang, Xiao Bai, Xin Ning, Jun Zhou, Edwin Hancock

Summary: This paper proposes a novel approach to estimate uncertainties in stereo matching end-to-end, using the NIG distribution to calculate uncertainties and additional loss functions to enhance sensitivity and smoothness. Experimental results show that this method improves stereo matching results, particularly performing well on out-of-distribution data.

PATTERN RECOGNITION (2022)

Article Computer Science, Artificial Intelligence

Information bottleneck and selective noise supervision for zero-shot learning

Lei Zhou, Yang Liu, Pengcheng Zhang, Xiao Bai, Lin Gu, Jun Zhou, Yazhou Yao, Tatsuya Harada, Jin Zheng, Edwin Hancock

Summary: Zero-shot learning aims to recognize novel classes by transferring semantic knowledge. The proposed bidirectional embedding based generative model introduces an information bottleneck constraint to preserve attribute information. Experimental results show that the method outperforms state-of-the-art methods on benchmark datasets.

MACHINE LEARNING (2023)

Article Computer Science, Artificial Intelligence

Direction of arrival estimation for indoor environments based on acoustic composition model with a single microphone

Xingchen Guo, Xuexin Xu, Xunquan Chen, Jinhui Chen, Rong Jia, Zhihong Zhang, Tetsuya Takiguchi, Edwin R. Hancock

Summary: This paper presents an effective method for multi-talker localization using only a single microphone in a room, which can successfully and accurately process the localization task. Experiments demonstrate the effectiveness of the proposed method.

PATTERN RECOGNITION (2022)

Article Computer Science, Artificial Intelligence

Graph Motif Entropy for Understanding Time-Evolving Networks

Zhihong Zhang, Dongdong Chen, Lu Bai, Jianjia Wang, Edwin R. Hancock

Summary: This article introduces the efficient representation of network structure using motifs and studies the distribution of subgraphs using statistical mechanics to understand the motif structure of a network. By mapping network motifs to clusters in a gas model, the partition function for a network is derived to calculate global thermodynamic quantities. Analytical expressions for the number of specific types of motifs and their associated entropy are presented. Numerical experiments on synthetic and real-world data sets evaluate the qualitative and quantitative characteristics of motif entropy derived from the partition function. The motif entropy for real-world networks, such as financial stock market networks, is found to be sensitive to the variance in network structure, indicating well-defined information-processing functions of network motifs.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2023)

Article Computer Science, Artificial Intelligence

Entropic Dynamic Time Warping Kernels for Co-Evolving Financial Time Series Analysis

Lu Bai, Lixin Cui, Zhihong Zhang, Lixiang Xu, Yue Wang, Edwin R. Hancock

Summary: This paper presents a novel framework for computing kernel-based similarity measures between dynamic time-varying financial networks, which is used to analyze financial time series. The commute time (CT) matrix is computed to identify a reliable set of correlated time series and their associated probability distributions. The dominant probability distributions are then used to construct a Shannon entropy time series, which is further used to develop an entropic dynamic time warping kernel for financial time series analysis. Experimental results demonstrate the effectiveness of the proposed method.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2023)

Article Computer Science, Artificial Intelligence

Position-aware and structure emb e dding networks for deep graph matching

Dongdong Chen, Yuxing Dai, Lichi Zhang, Zhihong Zhang, Edwin R. Hancock

Summary: This paper presents a novel neural framework that converts the graph matching problem into a linear assignment problem in a high-dimensional space. By leveraging relative position information at the node level and high-order structural arrangement information at the subgraph level, the method improves the performance of graph matching tasks and establishes reliable node-to-node correspondences.

PATTERN RECOGNITION (2023)

Article Automation & Control Systems

Regionwise Generative Adversarial Image Inpainting for Large Missing Areas

Yuqing Ma, Xianglong Liu, Shihao Bai, Lei Wang, Aishan Liu, Dacheng Tao, Edwin R. Hancock

Summary: In this study, a generic inpainting framework is proposed to handle incomplete images with both contiguous and discontiguous large missing areas. By employing an adversarial modeling and regionwise operations, the framework is able to generate semantically reasonable and visually realistic images, outperforming existing methods on large contiguous and discontiguous missing areas, as demonstrated by qualitative and quantitative experiments.

IEEE TRANSACTIONS ON CYBERNETICS (2023)

Article Computer Science, Artificial Intelligence

Learning Graph Convolutional Networks Based on Quantum Vertex Information Propagation

Lu Bai, Yuhang Jiao, Lixin Cui, Luca Rossi, Yue Wang, Philip S. Yu, Edwin R. Hancock

Summary: This paper proposes a new Quantum Spatial Graph Convolutional Neural Network (QSGCNN) model that can directly learn a classification function for graphs of arbitrary sizes. Unlike state-of-the-art Graph Convolutional Neural Network (GCNN) models, the proposed QSGCNN model incorporates the process of identifying transitive aligned vertices between graphs and transforms arbitrary sized graphs into fixed-sized aligned vertex grid structures. The effectiveness of the proposed QSGCNN model is demonstrated through experiments on benchmark graph classification datasets.

IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING (2023)

Article Computer Science, Artificial Intelligence

QBER: Quantum-based Entropic Representations for un-attributed graphs

Lixin Cui, Ming Li, Lu Bai, Yue Wang, Jing Li, Yanchao Wang, Zhao Li, Yunwen Chen, Edwin R. Hancock

Summary: This paper proposes a novel framework for computing Quantum-based Entropic Representations (QBER) for un-attributed graphs using Continuous-time Quantum Walk (CTQW). By transforming each original graph into a family of k-level neighborhood graphs, the framework captures multi-level topological information of the original global graph. The structure of each neighborhood graph is characterized using the Average Mixing Matrix (AMM) of CTQW, enabling the computation of Quantum Shannon Entropy and entropic signature. Experimental results demonstrate the effectiveness of the proposed approach in classification accuracies, outperforming other entropic complexity measuring methods, graph kernel methods, and graph deep learning methods.

PATTERN RECOGNITION (2024)

Proceedings Paper Computer Science, Artificial Intelligence

Learning Graph Convolutional Networks based on Quantum Vertex Information Propagation (Extended Abstract)

Lu Bai, Yuhang Jiao, Lixin Cui, Luca Rossi, Yue Wang, Philip S. Yu, Edwin R. Hancock

Summary: This paper proposes a novel Quantum Spatial Graph Convolutional Neural Network (QSGCNN) model that can directly learn a classification function for graphs of arbitrary sizes. The main idea is to define a new quantum-inspired spatial graph convolution associated with pre-transformed fixed-sized aligned grid structures of graphs, in terms of quantum information propagation between grid vertices of each graph. It effectively reduces the information loss or the notorious tottering problem arising in existing spatially-based Graph Convolutional Network (GCN) models.

2022 IEEE 38TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE 2022) (2022)

Article Computer Science, Artificial Intelligence

Uncalibrated, Two Source Photo-Polarimetric Stereo

Silvia Tozza, Dizhong Zhu, William A. P. Smith, Ravi Ramamoorthi, Edwin R. Hancock

Summary: In this paper, we present a method for estimating shape from polarisation and shading information under unknown illumination conditions. We propose alternative photo-polarimetric constraints and demonstrate how to express them using a unified system of partial differential equations, which allows for linear least squares solutions. We also introduce new methods for estimating polarisation images, albedo, and refractive index, and evaluate their performance on both synthetic and real-world data, showing improvements over existing state-of-the-art methods.

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2022)

Article Geochemistry & Geophysics

Structure-From-Motion With Varying Principal Point

W. A. P. Smith, P. Lewinska, M. A. Cooper, E. R. Hancock, J. A. Dowdeswell, D. M. Rippin

Summary: This paper studies the problem of structure-from-motion for images with varying principal point. Initialization and pose estimation methods specific to this scenario are proposed and the performance is demonstrated on challenging real-world examples.

IEEE GEOSCIENCE AND REMOTE SENSING LETTERS (2022)

Article Geography, Physical

Unravelling the long-term, locally heterogenous response of Greenland glaciers observed in archival photography

Michael A. Cooper, Paulina Lewinska, William A. P. Smith, Edwin R. Hancock, Julian A. Dowdeswell, David M. Rippin

Summary: This study presents an approach to extract quantifiable information from archival aerial photographs to extend the record of change in central eastern Greenland Ice Sheet. The insights gained from a longer record of ice margin change are crucial for understanding glacier response to climate change. The study also focuses on relatively small and understudied outlet glaciers from the eastern margin of the ice sheet, revealing significant heterogeneity in their response with non-climatic controls playing a key role.

CRYOSPHERE (2022)

No Data Available