4.7 Article

A comprehensive exploration of semantic relation extraction via pre-trained CNNs

Journal

KNOWLEDGE-BASED SYSTEMS
Volume 194, Issue -, Pages -

Publisher

ELSEVIER
DOI: 10.1016/j.knosys.2020.105488

Keywords

Relation extraction; Semantic relation; Natural language processing; Convolutional neural networks

Funding

  1. National Key Research and Development Program of China [2017YFB1402401]
  2. Fundamental Research Funds for the Central Universities [2018CDYJSY0055]
  3. Graduate Research and Innovation Foundation of Chongqing [CYB18058]
  4. Social Undertakings and Livelihood Security Science and Technology Innovation Funds of CQ CSTC [cstc2017shmsA0641]
  5. Key Research Program of Chongqing Science and Technology Bureau [cstc2018jszx-cyzdX0086, cstc2019jscx-fxyd0142, cstc2017zdcy-zdyf0150]

Ask authors/readers for more resources

Semantic relation extraction between entity pairs is a crucial task in information extraction from text. In this paper, we propose a new pre-trained network architecture for this task, and it is called the XM-CNN. The XM-CNN utilizes word embedding and position embedding information. It is designed to reinforce the contextual output from the MT-DNNKD pre-trained model. Our model effectively utilized an entity-aware attention mechanisms to detected the features and also adopts and applies more relation-specific pooling attention mechanisms applied to it. The experimental results show that the XM-CNN achieves state-of-the-art results on the SemEval-2010 task 8, and a thorough evaluation of the method is conducted. (C) 2020 Elsevier B.V. All rights reserved.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.7
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Fisheries

Andrographis paniculata improves growth and non-specific immunity of shrimp Litopenaeus vannamei, and protects it from Vibrio alginolyticus by reducing oxidative stress and apoptosis

Xiaoli Yin, Xueqi Zhuang, Meiqiu Liao, Qiqian Cui, Chunxia Yan, Jiayi Huang, Zixiang Jiang, Lin Huang, Weitao Luo, Yuan Liu, Weina Wang

Summary: Andrographis paniculata, a traditional medicinal plant, shows various pharmacological activities and can enhance the immune system and growth performance of Litopenaeus vannamei, while also providing protection against Vibrio alginolyticus.

DEVELOPMENTAL AND COMPARATIVE IMMUNOLOGY (2023)

Review Immunology

Thymosin alpha1 use in adult COVID-19 patients: A systematic review and meta-analysis on clinical outcomes

Weifeng Shang, Bo Zhang, Yali Ren, Weina Wang, Dengfeng Zhou, Yuanyuan Li

Summary: This systematic review and meta-analysis aimed to evaluate the effect of Thymosin alpha1 (Ta1) as a therapy for COVID-19. The results indicate that Ta1 therapy has no significant effect on hospitalized adult COVID-19 patients.

INTERNATIONAL IMMUNOPHARMACOLOGY (2023)

Article Engineering, Biomedical

Peptide GL13K releasing hydrogel functionalized micro/nanostructured titanium enhances its osteogenic and antibacterial activity

Xiaojing Zhang, Weina Wang, Jia Chen, Min Lai

Summary: In this study, a micro/nanostructured titanium surface was created by dual-acid treatment and anodic oxidation, and then coated with GelMA hydrogel loaded with GL13K to develop anti-bacterial titanium implants. The results showed that the modified titanium surface had good biocompatibility, promoted osteoblast differentiation, and prevented the growth of gram-positive and gram-negative bacteria by the release of GL13K.

JOURNAL OF BIOMATERIALS SCIENCE-POLYMER EDITION (2023)

Article Chemistry, Physical

Describing the adsorption of PAM on coal/kaolinite surface in aquatic by combining experiments and MD simulation

Miao Pan, Chenlong Duan, Long Huang, Weinan Wang, Haishen Jiang, Jinpeng Qiao, Yuemin Zhao

Summary: This study investigated the flocculation processes of coal sludge and kaolinite solutions, and analyzed the surface properties of the settling materials. The results showed that the flocculation effect increased and then decreased as the concentration of polyacrylamide (PAM) increased. The kaolinite particles covered the coal surface, reducing the exposed area and the amount of PAM molecules adsorbed. Understanding the effect of mineral hydration on the adsorption of flocculant molecules is important for improving solid-liquid separation.

JOURNAL OF MOLECULAR LIQUIDS (2023)

Article Medicine, Research & Experimental

M2 tumor-associated macrophage mediates the maintenance of stemness to promote cisplatin resistance by secreting TGF-beta 1 in esophageal squamous cell carcinoma

Kaige Yang, Yufang Xie, Lele Xue, Fanping Li, Chenghua Luo, Weihua Liang, Haijun Zhang, Ya Li, Yilin Ren, Mengmeng Zhao, Weinan Wang, Jia Liu, Xihua Shen, Wenhu Zhou, Jing Fei, Weigang Chen, Wenyi Gu, Lianghai Wang, Feng Li, Jianming Hu

Summary: This study found that M2 tumor-associated macrophages (M2-TAMs) promote stemness characteristics and induce cisplatin resistance in esophageal squamous cell carcinoma (ESCC) cells by secreting TGF-beta 1. This finding helps to understand the mechanism of chemotherapy resistance in ESCC.

JOURNAL OF TRANSLATIONAL MEDICINE (2023)

Article Immunology

Drug Resistance of Mycobacterium tuberculosis Based on Whole- Genome Sequencing in the Yi Ethnic Group, Sichuan Province, China

Wenfeng Gao, Xiaoru Chen, Liang Yao, Jing Li, Yuan Gao, Ting Li, Yunkui Li, Weina Wang, Shu Zhang, Jinge He

Summary: This study aimed to investigate drug-resistant tuberculosis (DR-TB) in the Yi ethnic group and its relationship with HIV/AIDS. Whole-genome sequencing was performed on Mycobacterium tuberculosis samples collected from the Yi ethnic group. The study found that re-treatment patients, women, and referred patients were at high risk of MDR/RR-TB or pre-XDR-TB. HIV and lineage 2 had negligible association with drug resistance. Whole-genome sequencing should be used to guide treatment regimens and interventions.

JOURNAL OF IMMUNOLOGY RESEARCH (2023)

Article Oncology

The role of non-invasive prenatal testing and ultrasound in prenatal screening of fetal chromosomal abnormalities in singleton: a retrospective study

Xiying Yuan, Wenjing Yong, Lei Dai, Weinan Wang, Lingqian Wu

Summary: This study analyzes the complementary roles of non-invasive prenatal testing (NIPT) and ultrasound phenotypes in prenatal screening of fetal chromosome abnormalities. The results show that ultrasound phenotypes are helpful in identifying false positive results, especially for T18 and T13. NIPT-Plus has important clinical significance in reducing missed diagnosis of SCA, MMS, and RAT, but its screening performance needs further improvement.

ANNALS OF TRANSLATIONAL MEDICINE (2023)

Article Biochemistry & Molecular Biology

Bioconversion of Ginsenoside Rf into Its Hydrated Derivative with Elevated Anti-inflammatory Effect by a Highly Specific Biocatalytic System of Cordyceps Sinensis

Jishuang Liu, Yu Xin, Zhidong Qiu, Qi Zhang, Tianzhu He, Ye Qiu, Weinan Wang

Summary: A biocatalytic system mediated by Cordyceps Sinensis transformed ginsenoside Rf specifically into 25-OH-(20S)-Rf with an 88.03% conversion rate. The time, structure, and bioactivity of the target compound were studied, indicating significant anti-inflammatory effects after saturation of the C24-C25 double bond. This biocatalytic system could be utilized for macrophage-mediated inflammation under specific conditions.

CHEMISTRY & BIODIVERSITY (2023)

Article Immunology

Bone marrow-derived mesenchymal stem cells accelerate angiogenesis in pregnant experimentally induced deep venous thrombosis rat model via up-regulation of pro-angiogenic secretogranin II

Xi Cheng, Mu Zhang, Yuanyuan Xie, Yanhua Xu, Rong Du, Bowen Wu, Zongyu Guan, Weina Wang, Weiwei Sun, Ting Xu, Shunxing Zhu, Liucheng Wu, Xu Wang, Hongyun Shi, Baolan Sun, Yuquan Zhang

Summary: This study investigated the effect of bone marrow-derived mesenchymal stem cells (BMMSCs) on angiogenesis and pregnancy outcomes in rats with obstetric deep venous thrombosis (DVT). The results showed that injecting BMMSCs into pregnant rats with DVT significantly reduced thrombus length and weight, promoted angiogenesis, and improved embryo absorption rate. In vitro experiments also demonstrated that BMMSC-derived conditioned medium (BM-CM) enhanced the abilities of impaired endothelial cells. Transcriptome sequencing revealed that BMMSCs upregulated the expression of pro-angiogenic genes, including secretogranin II (SCG2). Knocking down SCG2 expression attenuated the pro-angiogenic effects of BMMSCs. Overall, BMMSCs enhance angiogenesis via upregulation of SCG2, providing a potential therapy for obstetric DVT.

INTERNATIONAL IMMUNOPHARMACOLOGY (2023)

Article Oncology

hsa-miR-216a-3p regulates cell proliferation in oral cancer via the Wnt3a/β-catenin pathway

Yifan Wang, Shanshan Liu, Feifei Lv, Wenjing Zhai, Weina Wang, Yanhao Duan, Yongle Qiu

Summary: Oral cancer is a leading cause of death worldwide and requires more effective therapies. MiRNAs have shown therapeutic potential in various cancers. This study analyzed the miR-216a-3p/beta-catenin expression in oral cancer patients and found that miR-216a-3p was upregulated and positively correlated with tumor stage. Inhibition of miR-216a-3p suppressed cell viability and induced apoptosis in oral cancer cells. The effects of miR-216a-3p were mediated through the Wnt3a and beta-catenin signaling pathways.

MOLECULAR MEDICINE REPORTS (2023)

Article Biochemistry & Molecular Biology

The adrenal stress response is an essential host response against therapy-induced lethal immune activation

Ling Guo, Weinan Wang, Qian Wang, Dan Hao, Misa Ito, Bin Huang, Chieko Mineo, Philip W. Shaul, Jaebok Choi, L. Frank Huang, Xiang-An Li

Summary: Cytokine release syndrome (CRS) is a harmful systemic inflammatory syndrome that can lead to organ failure and death. Researchers have discovered that relative adrenal insufficiency (RAI) is a risk factor for severe CRS. By inducing glucocorticoids (GC) production through the scavenger receptor B1 (SR-BI), protection against lethal CRS can be achieved. Preemptive treatment with low doses of GC can effectively prevent CRS and improve survival in RAI patients without compromising T cell function.

SCIENCE SIGNALING (2023)

Article Obstetrics & Gynecology

Noninvasive prenatal testing, ultrasonographic findings and poor prenatal diagnosis rates for twin pregnancies: a retrospective study

Xiying Yuan, Weinan Wang, Lei Dai, Wenjing Yong, Chenlin Pei, Jingzhi Li, Lingqian Wu

Summary: This study aimed to evaluate the screening performance of NIPT for fetal chromosomal abnormalities in twin pregnancies and the PDR in the second and third trimesters. The results showed that the sensitivity, specificity, and positive predictive value of NIPT for trisomy 21 were 100%, 99.9%, and 75%, respectively. The PDR for high-risk NIPT results was 78.6%, and for low-risk NIPT results, it was 50%.

BMC PREGNANCY AND CHILDBIRTH (2023)

Article Environmental Sciences

Size Effects of Rough Fracture Seepage in Rocks of Different Scales

Zhuolin Shi, Qiangling Yao, Weinan Wang, Fengsheng Su, Xuehua Li, Liu Zhu, Chengle Wu

Summary: Percolation experiments were conducted on coal samples to study the effects of fracture length and inclination angle on seepage. A three-dimensional seepage model was constructed to investigate the seepage pattern. The results showed that permeability increases non-linearly with fracture length for small fractures, while it decreases and then increases for large fractures. The study provides insights into the mechanism of fracture seepage under different stress conditions.

WATER (2023)

Article Chemistry, Analytical

Compensation Method for the Nonlinear Characteristics with Starting Error of a Piezoelectric Actuator in Open-Loop Controls Based on the DSPI Model

Dong An, Ji Li, Songhua Li, Meng Shao, Weinan Wang, Chuan Wang, Yixiao Yang

Summary: This paper analyzes the causes of starting errors from both the physical properties of materials and voltages. It adopts an image-only model based on the classical Prandtl-Ishlinskii model to improve the positioning accuracy of the nanopositioning platform. The experimental results show that the DSPI model can solve the nonlinear start-up error problem existing under open-loop control and has better performance in terms of compensation results compared to other models.

MICROMACHINES (2023)

Review Chemistry, Multidisciplinary

The Time Variation Law of Concrete Compressive Strength: A Review

Weina Wang, Qingxia Yue

Summary: In this paper, the time variation law of the compressive strength of concrete was reviewed from three aspects: single, multiple and material internal factors. The mathematical models of compressive strength relative to time under single factors and the coupling effects of multiple factors were summarized. The differences in time variation models of compressive strength in existing buildings were discussed, and the influences of concrete internal factors on compressive strength were outlined.

APPLIED SCIENCES-BASEL (2023)

Article Computer Science, Artificial Intelligence

Confidence-based and sample-reweighted test-time adaptation

Hao Yang, Min Wang, Zhengfei Yu, Hang Zhang, Jinshen Jiang, Yun Zhou

Summary: In this paper, a novel method called CSTTA is proposed for test time adaptation (TTA), which utilizes confidence-based optimization and sample reweighting to better utilize sample information. Extensive experiments demonstrate the effectiveness of the proposed method.

KNOWLEDGE-BASED SYSTEMS (2024)

Article Computer Science, Artificial Intelligence

A novel method for generating a canonical basis for decision implications based on object-induced three-way operators

Jin Liu, Ju-Sheng Mi, Dong-Yun Niu

Summary: This article focuses on a novel method for generating a canonical basis for decision implications based on object-induced operators (OE operators). The logic of decision implication based on OE operators is described, and a method for obtaining the canonical basis for decision implications is given. The completeness, nonredundancy, and optimality of the canonical basis are proven. Additionally, a method for generating true premises based on OE operators is proposed.

KNOWLEDGE-BASED SYSTEMS (2024)

Review Computer Science, Artificial Intelligence

Efficient utilization of pre-trained models: A review of sentiment analysis via prompt learning

Kun Bu, Yuanchao Liu, Xiaolong Ju

Summary: This paper discusses the importance of sentiment analysis and pre-trained models in natural language processing, and explores the application of prompt learning. The research shows that prompt learning is more suitable for sentiment analysis tasks and can achieve good performance.

KNOWLEDGE-BASED SYSTEMS (2024)

Article Computer Science, Artificial Intelligence

M-EDEM: A MNN-based Empirical Decomposition Ensemble Method for improved time series forecasting

Xiangjun Cai, Dagang Li

Summary: This paper presents a new decomposition mechanism based on learned decomposition mapping. By using a neural network to learn the relationship between original time series and decomposed results, the repetitive computation overhead during rolling decomposition is relieved. Additionally, extended mapping and partial decomposition methods are proposed to alleviate boundary effects on prediction performance. Comparative studies demonstrate that the proposed method outperforms existing RDEMs in terms of operation speed and prediction accuracy.

KNOWLEDGE-BASED SYSTEMS (2024)

Article Computer Science, Artificial Intelligence

Privacy-preserving trust management method based on blockchain for cross-domain industrial IoT

Xu Wu, Yang Liu, Jie Tian, Yuanpeng Li

Summary: This paper proposes a blockchain-based privacy-preserving trust management architecture, which adopts federated learning to train task-specific trust models and utilizes differential privacy to protect device privacy. In addition, a game theory-based incentive mechanism and a parallel consensus protocol are proposed to improve the accuracy of trust computing and the efficiency of consensus.

KNOWLEDGE-BASED SYSTEMS (2024)

Article Computer Science, Artificial Intelligence

MV-ReID: 3D Multi-view Transformation Network for Occluded Person Re-Identification

Zaiyang Yu, Prayag Tiwari, Luyang Hou, Lusi Li, Weijun Li, Limin Jiang, Xin Ning

Summary: This study introduces a 3D view-based approach that effectively handles occlusions and leverages the geometric information of 3D objects. The proposed method achieves state-of-the-art results on occluded ReID tasks and exhibits competitive performance on holistic ReID tasks.

KNOWLEDGE-BASED SYSTEMS (2024)

Article Computer Science, Artificial Intelligence

City-scale continual neural semantic mapping with three-layer sampling and panoptic representation

Yongliang Shi, Runyi Yang, Zirui Wu, Pengfei Li, Caiyun Liu, Hao Zhao, Guyue Zhou

Summary: Neural implicit representations have gained attention due to their expressive, continuous, and compact properties. However, there is still a lack of research on city-scale continual implicit dense mapping based on sparse LiDAR input. In this study, a city-scale continual neural mapping system with a panoptic representation is developed, incorporating environment-level and instance-level modeling. A tailored three-layer sampling strategy and category-specific prior are proposed to address the challenges of representing geometric information in city-scale space and achieving high fidelity mapping of instances under incomplete observation.

KNOWLEDGE-BASED SYSTEMS (2024)

Article Computer Science, Artificial Intelligence

MDSSN: An end-to-end deep network on triangle mesh parameterization

Ruihan Hu, Zhi-Ri Tang, Rui Yang, Zhongjie Wang

Summary: Mesh data is crucial for 3D computer vision applications worldwide, but traditional deep learning frameworks have struggled with handling meshes. This paper proposes MDSSN, a simple mesh computation framework that models triangle meshes and represents their shape using face-based and edge-based Riemannian graphs. The framework incorporates end-to-end operators inspired by traditional deep learning frameworks, and includes dedicated modules for addressing challenges in mesh classification and segmentation tasks. Experimental results demonstrate that MDSSN outperforms other state-of-the-art approaches.

KNOWLEDGE-BASED SYSTEMS (2024)

Article Computer Science, Artificial Intelligence

Semi-supervised learning with missing values imputation

Buliao Huang, Yunhui Zhu, Muhammad Usman, Huanhuan Chen

Summary: This paper proposes a novel semi-supervised conditional normalizing flow (SSCFlow) algorithm that combines unsupervised imputation and supervised classification. By estimating the conditional distribution of incomplete instances, SSCFlow facilitates imputation and classification simultaneously, addressing the issue of separated tasks ignoring data distribution and label information in traditional methods.

KNOWLEDGE-BASED SYSTEMS (2024)

Article Computer Science, Artificial Intelligence

Emotion-and-knowledge grounded response generation in an open-domain dialogue setting

Deeksha Varshney, Asif Ekbal, Erik Cambria

Summary: This paper focuses on the neural-based interactive dialogue system that aims to engage and retain humans in long-lasting conversations. It proposes a new neural generative model that combines step-wise co-attention, self-attention-based transformer network, and an emotion classifier to control emotion and knowledge transfer during response generation. The results from quantitative, qualitative, and human evaluation show that the proposed models can generate natural and coherent sentences, capturing essential facts with significant improvement over emotional content.

KNOWLEDGE-BASED SYSTEMS (2024)

Article Computer Science, Artificial Intelligence

MvTS-library: An open library for deep multivariate time series forecasting

Junchen Ye, Weimiao Li, Zhixin Zhang, Tongyu Zhu, Leilei Sun, Bowen Du

Summary: Modeling multivariate time series has long been a topic of interest for scholars in various fields. This paper introduces MvTS, an open library based on Pytorch, which provides a unified framework for implementing and evaluating these models. Extensive experiments on public datasets demonstrate the effectiveness and universality of the models reproduced by MvTS.

KNOWLEDGE-BASED SYSTEMS (2024)

Article Computer Science, Artificial Intelligence

An adaptive hybrid mutated differential evolution feature selection method for low and high-dimensional medical datasets

Reham R. Mostafa, Ahmed M. Khedr, Zaher Al Aghbari, Imad Afyouni, Ibrahim Kamel, Naveed Ahmed

Summary: Feature selection is crucial in classification procedures, but it faces challenges in high-dimensional datasets. To overcome these challenges, this study proposes an Adaptive Hybrid-Mutated Differential Evolution method that incorporates the mechanics of the Spider Wasp Optimization algorithm and the concept of Enhanced Solution Quality. Experimental results demonstrate the effectiveness of the method in terms of accuracy and convergence speed, and it outperforms contemporary cutting-edge algorithms.

KNOWLEDGE-BASED SYSTEMS (2024)

Article Computer Science, Artificial Intelligence

TCM Model for improving track sequence classification in real scenarios with Multi-Feature Fusion and Transformer Block

Ti Xiang, Pin Lv, Liguo Sun, Yipu Yang, Jiuwu Hao

Summary: This paper introduces a Track Classification Model (TCM) based on marine radar, which can effectively recognize and classify shipping tracks. By using a feature extraction network with multi-feature fusion and a dataset production method to address missing labels, the classification accuracy is improved, resulting in successful engineering application in real scenarios.

KNOWLEDGE-BASED SYSTEMS (2024)

Article Computer Science, Artificial Intelligence

Language model as an Annotator: Unsupervised context-aware quality phrase generation

Zhihao Zhang, Yuan Zuo, Chenghua Lin, Junjie Wu

Summary: This paper proposes a novel unsupervised context-aware quality phrase mining framework called LMPhrase, which is built upon large pre-trained language models. The framework mines quality phrases as silver labels using a parameter-free probing technique on the pre-trained language model BERT, and formalizes the phrase tagging task as a sequence generation problem by fine-tuning on the Sequence to-Sequence pre-trained language model BART. The results of extensive experiments show that LMPhrase consistently outperforms existing competitors in two different granularity phrase mining tasks.

KNOWLEDGE-BASED SYSTEMS (2024)

Article Computer Science, Artificial Intelligence

Stochastic Gradient Descent for matrix completion: Hybrid parallelization on shared- and distributed-memory systems

Kemal Buyukkaya, M. Ozan Karsavuran, Cevdet Aykanat

Summary: The study aims to investigate the hybrid parallelization of the Stochastic Gradient Descent (SGD) algorithm for solving the matrix completion problem on a high-performance computing platform. A hybrid parallel decentralized SGD framework with asynchronous inter-process communication and a novel flexible partitioning scheme is proposed to achieve scalability up to hundreds of processors. Experimental results on real-world benchmark datasets show that the proposed algorithm achieves 6x higher throughput on sparse datasets compared to the state-of-the-art, while achieving comparable throughput on relatively dense datasets.

KNOWLEDGE-BASED SYSTEMS (2024)