4.7 Article

Automatic feature localisation with constrained local models

期刊

PATTERN RECOGNITION
卷 41, 期 10, 页码 3054-3067

出版社

ELSEVIER SCI LTD
DOI: 10.1016/j.patcog.2008.01.024

关键词

shape modelling; feature detectors; object detection; object localisation; face detection; active appearance models; constrained local models

资金

  1. EPSRC [EP/D056942/1] Funding Source: UKRI
  2. Engineering and Physical Sciences Research Council [EP/D056942/1] Funding Source: researchfish

向作者/读者索取更多资源

We present an efficient and robust method of locating a set of feature points in an object of interest. From a training set we construct a joint model of the appearance of each feature together with their relative positions. The model is fitted to an unseen image in an iterative manner by generating templates using the joint model and the current parameter estimates, correlating the templates with the target image to generate response images and optimising the shape parameters so as to maximise the sum of responses. The appearance model is similar to that used in the Active Appearance Models (AAM) [T.F. Cootes, G.J. Edwards, C.J. Taylor, Active appearance models, in: Proceedings of the 5th European Conference on Computer Vision 1998, vol. 2, Freiburg, Germany, 1998.]. However in our approach the appearance model is used to generate likely feature templates, instead of trying to approximate the image pixels directly. We show that when applied to a wide range of data sets, our Constrained Local Model (CLM) algorithm is more robust and more accurate than the AAM search method, which relies on the image reconstruction error to update the model parameters. We demonstrate improved localisation accuracy on photographs of human faces, magnetic resonance (MR) images of the brain and a set of dental panoramic tomograms. We also show improved tracking performance on a challenging set of in car video sequences. (C) 2008 Elsevier Ltd. All rights reserved.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.7
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

Article Rheumatology

Synovial tissue volume: a treatment target in knee osteoarthritis (OA)

Terence W. O'Neill, Matthew J. Parkes, Nasimah Maricar, Elizabeth J. Marjanovic, Richard Hodgson, Andrew D. Gait, Timothy F. Cootes, Charles E. Hutchinson, David T. Felson

ANNALS OF THE RHEUMATIC DISEASES (2016)

Correction Orthopedics

Synovial volume vs synovial measurements from dynamic contrast enhanced MRI as measures of response in osteoarthritis (vol 24, pg 1392, 2016)

A. D. Gait, R. Hodgson, M. J. Parkes, C. E. Hutchinson, T. W. O'Neill, N. Maricar, E. J. Marjanovic, T. F. Cootes, D. T. Felson

OSTEOARTHRITIS AND CARTILAGE (2017)

Article Rheumatology

Comparing image analysis approaches versus expert readers: the relation of knee radiograph features to knee pain

Luca Minciullo, Matthew J. Parkes, David T. Felson, Timothy F. Cootes

ANNALS OF THE RHEUMATIC DISEASES (2018)

Article Multidisciplinary Sciences

Modeling the shape and composition of the human body using dual energy X-ray absorptiometry images

John A. Shepherd, Bennett K. Ng', Bo Fan, Ann V. Schwartz, Peggy Cawthon, Steven R. Cummings, Stephen Kritchevsky, Michael Nevitt, Adam Santanasto, Timothy F. Cootes

PLOS ONE (2017)

Article Multidisciplinary Sciences

Fully Automatic System for Accurate Localisation and Analysis of Cephalometric Landmarks in Lateral Cephalograms

Claudia Lindner, Ching-Wei Wang, Cheng-Ta Huang, Chung-Hsing Li, Sheng-Wei Chang, Tim F. Cootes

SCIENTIFIC REPORTS (2016)

Article Radiology, Nuclear Medicine & Medical Imaging

Measurement of synovial tissue volume in knee osteoarthritis using a semiautomated MRI-based quantitative approach

Thomas A. Perry, Andrew Gait, Terence W. O'Neill, Matthew J. Parkes, Richard Hodgson, Michael J. Callaghan, Nigel K. Arden, David T. Felson, Timothy F. Cootes

MAGNETIC RESONANCE IN MEDICINE (2019)

Article Multidisciplinary Sciences

Measuring vision using innate behaviours in mice with intact and impaired retina function

R. Storchi, J. Rodgers, M. Gracey, F. P. Martial, J. Wynne, S. Ryan, C. J. Twining, T. F. Cootes, R. Killick, R. J. Lucas

SCIENTIFIC REPORTS (2019)

Article Biochemistry & Molecular Biology

A High-Dimensional Quantification of Mouse Defensive Behaviors Reveals Enhanced Diversity and Stimulus Specificity

Riccardo Storchi, Nina Milosavljevic, Annette E. Allen, Antonio G. Zippo, Aayushi Agnihotri, Timothy F. Cootes, Robert J. Lucas

CURRENT BIOLOGY (2020)

Article Computer Science, Artificial Intelligence

Automatic aerospace weld inspection using unsupervised local deep feature learning

Xinghui Dong, Chris J. Taylor, Tim F. Cootes

Summary: This study introduces an unsupervised local deep feature learning method based on image segmentation, aiming to extract useful features from images. By utilizing pseudo-labels and training algorithms with deep convolutional neural networks, the proposed unsupervised method achieves performance close to supervised learning.

KNOWLEDGE-BASED SYSTEMS (2021)

Article Endocrinology & Metabolism

Osteophyte size and location on hip DXA scans are associated with hip pain: Findings from a cross sectional study in UK Biobank

Benjamin G. Faber, Raja Ebsim, Fiona R. Saunders, Monika Frysz, Claudia Lindner, Jennifer S. Gregory, Richard M. Aspden, Nicholas C. Harvey, George Davey Smith, Timothy Cootes, Jonathan H. Tobias

Summary: This study investigated the relationship between radiographic hip osteoarthritis (rHOA) and hip pain using a novel method. The results showed that 2-dimensional osteophyte area was significantly associated with hip pain, while minimum joint space width (mJSW) was not. Furthermore, osteophyte areas at different locations were independently associated with hip pain, potentially reflecting distinct biomechanical pathways.
Article Automation & Control Systems

A Random Forest-Based Automatic Inspection System for Aerospace Welds in X-Ray Images

Xinghui Dong, Christopher J. Taylor, Tim F. Cootes

Summary: In the aerospace manufacturing industry, an automatic inspection system has been developed to identify defects in linear thin welds, aiming to reduce the workload for human inspectors. Experimental results show that the system can accurately locate welds and detect 80% of defects. Additionally, the system produces promising results on publicly available data sets.

IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING (2021)

Article Orthopedics

High bone mass and cam morphology are independently related to hip osteoarthritis: findings from the High Bone Mass cohort

B. E. Zucker, R. Ebsim, C. Lindner, S. Hardcastle, T. Cootes, J. H. Tobias, M. R. Whitehouse, C. L. Gregson, B. G. Faber, A. E. Hartley

Summary: The study found an association between cam morphology and radiographic hip osteoarthritis in individuals with high bone mass, but no association between cam morphology and incident osteoarthritis. High bone mass and cam morphology confer risks of osteoarthritis through distinct pathways.

BMC MUSCULOSKELETAL DISORDERS (2022)

Article Automation & Control Systems

Defect Classification and Detection Using a Multitask Deep One-Class CNN

Xinghui Dong, Christopher J. Taylor, Tim F. Cootes

Summary: This study proposes a multitask deep one-class CNN for defect classification, eliminating the need for abnormal images and annotated data during training, and utilizing feature representation learning from normal images. The approach outperforms counterparts trained using a two-stage method in defect detection, achieving results nearly as good as the supervised method without using annotated data. The promising results are attributed to the advantages of multitask learning.

IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING (2022)

Proceedings Paper Engineering, Biomedical

Combination of Lateral and PA View Radiographs to Study Development of Knee OA and Associated Pain

Luca Minciullo, Jessie Thomson, Timothy F. Cootes

MEDICAL IMAGING 2017: COMPUTER-AIDED DIAGNOSIS (2017)

Proceedings Paper Computer Science, Theory & Methods

Fully Automatic Detection of Distal Radius Fractures from Posteroanterior and Lateral Radiographs

Raja Ebsim, Jawad Naqvi, Tim Cootes

COMPUTER ASSISTED AND ROBOTIC ENDOSCOPY AND CLINICAL IMAGE-BASED PROCEDURES (2017)

Article Computer Science, Artificial Intelligence

Exploiting sublimated deep features for image retrieval

Guang-Hai Liu, Zuo-Yong Li, Jing-Yu Yang, David Zhang

Summary: This article introduces a novel image retrieval method that improves retrieval performance by using sublimated deep features. The method incorporates orientation-selective features and color perceptual features, effectively mimicking these mechanisms to provide a more discriminating representation.

PATTERN RECOGNITION (2024)

Article Computer Science, Artificial Intelligence

Region-adaptive and context-complementary cross modulation for RGB-T semantic segmentation

Fengguang Peng, Zihan Ding, Ziming Chen, Gang Wang, Tianrui Hui, Si Liu, Hang Shi

Summary: RGB-Thermal (RGB-T) semantic segmentation is an emerging task that aims to improve the robustness of segmentation methods under extreme imaging conditions by using thermal infrared modality. The challenges of foreground-background distinguishment and complementary information mining are addressed by proposing a cross modulation process with two collaborative components. Experimental results show that the proposed method achieves state-of-the-art performances on current RGB-T segmentation benchmarks.

PATTERN RECOGNITION (2024)

Article Computer Science, Artificial Intelligence

F-SCP: An automatic prompt generation method for specific classes based on visual language pre-training models

Baihong Han, Xiaoyan Jiang, Zhijun Fang, Hamido Fujita, Yongbin Gao

Summary: This paper proposes a novel automatic prompt generation method called F-SCP, which focuses on generating accurate prompts for low-accuracy classes and similar classes. Experimental results show that our approach outperforms state-of-the-art methods on six multi-domain datasets.

PATTERN RECOGNITION (2024)

Article Computer Science, Artificial Intelligence

Residual Deformable Convolution for better image de-weathering

Huikai Liu, Ao Zhang, Wenqian Zhu, Bin Fu, Bingjian Ding, Shengwu Xiong

Summary: Adverse weather conditions present challenges for computer vision tasks, and image de-weathering is an important component of image restoration. This paper proposes a multi-patch skip-forward structure and a Residual Deformable Convolutional module to improve feature extraction and pixel-wise reconstruction.

PATTERN RECOGNITION (2024)

Article Computer Science, Artificial Intelligence

A linear transportation LP distance for pattern recognition

Oliver M. Crook, Mihai Cucuringu, Tim Hurst, Carola-Bibiane Schonlieb, Matthew Thorpe, Konstantinos C. Zygalakis

Summary: The transportation LP distance (TLP) is a generalization of the Wasserstein WP distance that can be applied directly to color or multi-channelled images, as well as multivariate time-series. TLP interprets signals as functions, while WP interprets signals as measures. Although both distances are powerful tools in modeling data with spatial or temporal perturbations, their computational cost can be prohibitively high for moderate pattern recognition tasks. The linear Wasserstein distance offers a method for projecting signals into a Euclidean space, and in this study, we propose linear versions of the TLP distance (LTLP) that show significant improvement over the linear WP distance in signal processing tasks while being several orders of magnitude faster to compute than the TLP distance.

PATTERN RECOGNITION (2024)

Article Computer Science, Artificial Intelligence

Learning a target-dependent classifier for cross-domain semantic segmentation: Fine-tuning versus meta-learning

Haitao Tian, Shiru Qu, Pierre Payeur

Summary: This paper proposes a method of target-dependent classifier, which optimizes the joint hypothesis of domain adaptation into a target-dependent hypothesis that better fits with the target domain clusters through an unsupervised fine-tuning strategy and the concept of meta-learning. Experimental results demonstrate that this method outperforms existing techniques in synthetic-to-real adaptation and cross-city adaptation benchmarks.

PATTERN RECOGNITION (2024)

Article Computer Science, Artificial Intelligence

KGSR: A kernel guided network for real-world blind super-resolution

Qingsen Yan, Axi Niu, Chaoqun Wang, Wei Dong, Marcin Wozniak, Yanning Zhang

Summary: Deep learning-based methods have achieved remarkable results in the field of super-resolution. However, the limitation of paired training image sets has led researchers to explore self-supervised learning. However, the assumption of inaccurate downscaling kernel functions often leads to degraded results. To address this issue, this paper introduces KGSR, a kernel-guided network that trains both upscaling and downscaling networks to generate high-quality high-resolution images even without knowing the actual downscaling process.

PATTERN RECOGNITION (2024)

Article Computer Science, Artificial Intelligence

Gait feature learning via spatio-temporal two-branch networks

Yifan Chen, Xuelong Li

Summary: Gait recognition is a popular technology for identification due to its ability to capture gait features over long distances without cooperation. However, current methods face challenges as they use a single network to extract both temporal and spatial features. To solve this problem, we propose a two-branch network that focuses on spatial and temporal feature extraction separately. By combining these features, we can effectively learn the spatio-temporal information of gait sequences.

PATTERN RECOGNITION (2024)

Article Computer Science, Artificial Intelligence

PAMI: Partition Input and Aggregate Outputs for Model Interpretation

Wei Shi, Wentao Zhang, Wei-shi Zheng, Ruixuan Wang

Summary: This article proposes a simple yet effective visualization framework called PAMI, which does not require detailed model structure and parameters to obtain visualization results. It can be applied to various prediction tasks with different model backbones and input formats.

PATTERN RECOGNITION (2024)

Article Computer Science, Artificial Intelligence

Disturbance rejection with compensation on features

Xiaobo Hu, Jianbo Su, Jun Zhang

Summary: This paper reviews the latest technologies in pattern recognition, highlighting their instabilities and failures in practical applications. From a control perspective, the significance of disturbance rejection in pattern recognition is discussed, and the existing problems are summarized. Finally, potential solutions related to the application of compensation on features are discussed to emphasize future research directions.

PATTERN RECOGNITION (2024)

Article Computer Science, Artificial Intelligence

ECLAD: Extracting Concepts with Local Aggregated Descriptors

Andres Felipe Posada-Moreno, Nikita Surya, Sebastian Trimpe

Summary: Convolutional neural networks are widely used in critical systems, and explainable artificial intelligence has proposed methods for generating high-level explanations. However, these methods lack the ability to determine the location of concepts. To address this, we propose a novel method for automatic concept extraction and localization based on pixel-wise aggregations, and validate it using synthetic datasets.

PATTERN RECOGNITION (2024)

Article Computer Science, Artificial Intelligence

Dynamic Graph Contrastive Learning via Maximize Temporal Consistency

Peng Bao, Jianian Li, Rong Yan, Zhongyi Liu

Summary: In this paper, a novel Dynamic Graph Contrastive Learning framework, DyGCL, is proposed to capture the temporal consistency in dynamic graphs and achieve good performance in node representation learning.

PATTERN RECOGNITION (2024)

Article Computer Science, Artificial Intelligence

ConvGeN: A convex space learning approach for deep-generative oversampling and imbalanced classification of small tabular datasets

Kristian Schultz, Saptarshi Bej, Waldemar Hahn, Markus Wolfien, Prashant Srivastava, Olaf Wolkenhauer

Summary: Research indicates that deep generative models perform poorly compared to linear interpolation-based methods for synthetic data generation on small, imbalanced tabular datasets. To address this, a new approach called ConvGeN, combining convex space learning with deep generative models, has been proposed. ConvGeN improves imbalanced classification on small datasets while remaining competitive with existing linear interpolation methods.

PATTERN RECOGNITION (2024)

Article Computer Science, Artificial Intelligence

H-CapsNet: A capsule network for hierarchical image classification

Khondaker Tasrif Noor, Antonio Robles-Kelly

Summary: In this paper, the authors propose H-CapsNet, a capsule network designed for hierarchical image classification. The network effectively captures hierarchical relationships using dedicated capsules for each class hierarchy. A modified hinge loss is utilized to enforce consistency among the involved hierarchies. Additionally, a strategy for dynamically adjusting training parameters is presented to achieve better balance between the class hierarchies. Experimental results demonstrate that H-CapsNet outperforms competing hierarchical classification networks.

PATTERN RECOGNITION (2024)

Article Computer Science, Artificial Intelligence

CS-net: Conv-simpleformer network for agricultural image segmentation

Lei Liu, Guorun Li, Yuefeng Du, Xiaoyu Li, Xiuheng Wu, Zhi Qiao, Tianyi Wang

Summary: This study proposes a new agricultural image segmentation model called CS-Net, which uses Simple-Attention Block and Simpleformer to improve accuracy and inference speed, and addresses the issue of performance collapse of Transformers in agricultural image processing.

PATTERN RECOGNITION (2024)