-
URRL-IMVC: Unified and Robust Representation Learning for Incomplete Multi-View Clustering
Authors:
Ge Teng,
Ting Mao,
Chen Shen,
Xiang Tian,
Xuesong Liu,
Yaowu Chen,
Jieping Ye
Abstract:
Incomplete multi-view clustering (IMVC) aims to cluster multi-view data that are only partially available. This poses two main challenges: effectively leveraging multi-view information and mitigating the impact of missing views. Prevailing solutions employ cross-view contrastive learning and missing view recovery techniques. However, they either neglect valuable complementary information by focusi…
▽ More
Incomplete multi-view clustering (IMVC) aims to cluster multi-view data that are only partially available. This poses two main challenges: effectively leveraging multi-view information and mitigating the impact of missing views. Prevailing solutions employ cross-view contrastive learning and missing view recovery techniques. However, they either neglect valuable complementary information by focusing only on consensus between views or provide unreliable recovered views due to the absence of supervision. To address these limitations, we propose a novel Unified and Robust Representation Learning for Incomplete Multi-View Clustering (URRL-IMVC). URRL-IMVC directly learns a unified embedding that is robust to view missing conditions by integrating information from multiple views and neighboring samples. Firstly, to overcome the limitations of cross-view contrastive learning, URRL-IMVC incorporates an attention-based auto-encoder framework to fuse multi-view information and generate unified embeddings. Secondly, URRL-IMVC directly enhances the robustness of the unified embedding against view-missing conditions through KNN imputation and data augmentation techniques, eliminating the need for explicit missing view recovery. Finally, incremental improvements are introduced to further enhance the overall performance, such as the Clustering Module and the customization of the Encoder. We extensively evaluate the proposed URRL-IMVC framework on various benchmark datasets, demonstrating its state-of-the-art performance. Furthermore, comprehensive ablation studies are performed to validate the effectiveness of our design.
△ Less
Submitted 12 July, 2024;
originally announced July 2024.
-
Kaggle Kinship Recognition Challenge: Introduction of Convolution-Free Model to boost conventional
Authors:
Mingchuan Tian,
Guangway Teng,
Yipeng Bao
Abstract:
This work aims to explore a convolution-free base classifier that can be used to widen the variations of the conventional ensemble classifier. Specifically, we propose Vision Transformers as base classifiers to combine with CNNs for a unique ensemble solution in Kaggle kinship recognition. In this paper, we verify our proposed idea by implementing and optimizing variants of the Vision Transformer…
▽ More
This work aims to explore a convolution-free base classifier that can be used to widen the variations of the conventional ensemble classifier. Specifically, we propose Vision Transformers as base classifiers to combine with CNNs for a unique ensemble solution in Kaggle kinship recognition. In this paper, we verify our proposed idea by implementing and optimizing variants of the Vision Transformer model on top of the existing CNN models. The combined models achieve better scores than conventional ensemble classifiers based solely on CNN variants. We demonstrate that highly optimized CNN ensembles publicly available on the Kaggle Discussion board can easily achieve a significant boost in ROC score by simply ensemble with variants of the Vision Transformer model due to low correlation.
△ Less
Submitted 11 June, 2022;
originally announced June 2022.
-
Insight into the origin of Lithium/Nickel ions exchange in layered Li(NixMnyCoz)O2 cathode materials
Authors:
Yinguo Xiao,
Tongchao Liu,
Jiajie Liu,
Lunhua He,
Jie Chen,
Junrong Zhang,
Ping Luo,
Huaile Lu,
Rui Wang,
Weiming Zhu,
Zongxiang Hu,
Gaofeng Teng,
Chao Xin,
Jiaxin Zheng,
Tianjiao Liang,
Fangwei Wang,
Yuanbo Chen,
Qingzhen Huang,
Feng Pan,
Hesheng Chen
Abstract:
In layered LiNixMnyCozO2 cathode material for lithium-ion batteries, the spins of transition metal (TM) ions construct a two-dimensional triangular networks, which can be considered as a simple case of geometrical frustration. By performing neutron powder diffraction experiments and magnetization measurements, we find that long-range magnetic order cannot be established in LiNixMnyCozO2 even at lo…
▽ More
In layered LiNixMnyCozO2 cathode material for lithium-ion batteries, the spins of transition metal (TM) ions construct a two-dimensional triangular networks, which can be considered as a simple case of geometrical frustration. By performing neutron powder diffraction experiments and magnetization measurements, we find that long-range magnetic order cannot be established in LiNixMnyCozO2 even at low temperature of 3 K. Remarkably, the frustration parameters of these compounds are estimated to be larger than 30, indicating the existence of strongly frustrated magnetic interactions between spins of TM ions. As frustration will inevitably give rise to lattice instability, the formation of Li/Ni exchange in LiNixMnyCozO2 will help to partially relieve the degeneracy of the frustrated magnetic lattice by forming a stable antiferromagnetic state in hexagonal sublattice with nonmagnetic ions located in centers of the hexagons. Moreover, Li/Ni exchange will introduce 180° superexchange interaction, which further relieves the magnetic frustration through bringing in new exchange paths. Thus, the variation of Li/Ni exchange ratio vs. TM mole fraction in LiNixMnyCozO2 with different compositions can be well understood and predicted in terms of magnetic frustration and superexchange interactions. This provides a unique viewpoint to study the Li/Ni ions exchange in layered Li(NixMnyCoz)O2 cathode materials.
△ Less
Submitted 12 April, 2018;
originally announced April 2018.
